-- Logs begin at Fri 2022-04-08 01:55:00 UTC, end at Fri 2022-04-08 03:10:48 UTC. -- Apr 08 02:25:05.059349 dv-cinder-837051-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 08 02:25:05.067622 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 8 02:25:05 2022] *** Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: nodename: dv-cinder-837051-1-iscsi Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: machine: x86_64 Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: clock source: unix Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: pcre jit disabled Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: detected number of CPU cores: 4 Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: current working directory: / Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: detected binary path: /usr/bin/uwsgi-core Apr 08 02:25:05.072007 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: your processes number limit is 47680 Apr 08 02:25:05.072589 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: your memory page size is 4096 bytes Apr 08 02:25:05.072589 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: detected max file descriptor number: 2048 Apr 08 02:25:05.072589 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: lock engine: pthread robust mutexes Apr 08 02:25:05.072589 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: thunder lock: enabled Apr 08 02:25:05.072589 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 08 02:25:05.072589 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 08 02:25:05.116083 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: Python main interpreter initialized at 0x55684cef89c0 Apr 08 02:25:05.116083 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: python threads support enabled Apr 08 02:25:05.116083 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: your server socket listen backlog is limited to 100 connections Apr 08 02:25:05.116083 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: your mercy for graceful operations on workers is 90 seconds Apr 08 02:25:05.116432 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: mapped 403077 bytes (393 KB) for 2 cores Apr 08 02:25:05.116550 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: *** Operational MODE: preforking *** Apr 08 02:25:05.116776 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: *** uWSGI is running in multiple interpreter mode *** Apr 08 02:25:05.116776 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: spawned uWSGI master process (pid: 66984) Apr 08 02:25:05.116983 dv-cinder-837051-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 08 02:25:05.118502 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: spawned uWSGI worker 1 (pid: 66995, cores: 1) Apr 08 02:25:05.118502 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: spawned uWSGI worker 2 (pid: 66996, cores: 1) Apr 08 02:25:05.118502 dv-cinder-837051-1-iscsi devstack@keystone.service[66984]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 08 02:25:10.009815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:25:10.009815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: from cryptography.utils import int_from_bytes Apr 08 02:25:10.010837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:25:10.010837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: from cryptography.utils import int_from_bytes Apr 08 02:25:10.014994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:25:10.014994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: from cryptography.utils import int_from_bytes Apr 08 02:25:10.015468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 08 02:25:10.015468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: from cryptography.utils import int_from_bytes Apr 08 02:25:10.060195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:25:10.060380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:25:10.060547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] command line args: [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:25:10.060810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:25:10.060983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ================================================================================ {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:25:10.061232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] admin_token = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.061472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] config_dir = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.061654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.061829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] config_source = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.062004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] debug = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.062198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.062559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.062736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.062980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.063226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.063450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] list_limit = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.063626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] log_config_append = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.063790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 08 02:25:10.063903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.064063 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] log_dir = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.064161 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 08 02:25:10.064262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] log_file = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.064370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] command line args: [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 08 02:25:10.064471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.064567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 08 02:25:10.064686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ================================================================================ {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 08 02:25:10.064807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.064926 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] admin_token = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] config_dir = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] config_source = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] debug = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.065975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066460 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.066951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] list_limit = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] log_config_append = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.067760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] log_dir = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] log_file = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] publish_errors = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068823 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.068932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.069047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.069173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.069294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.069450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.069640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.069816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.069944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] standard_threads = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.070931 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] use_journal = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] use_json = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] use_stderr = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.071913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] use_syslog = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.072164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.072285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.072399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] publish_errors = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.072511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.072634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.072749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.072868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.072982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.073100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.073214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.073333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.073446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.073564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.073677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.073790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] standard_threads = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.073908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.074029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.074142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.074266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.074266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.074474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.074586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] use_journal = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.074706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.074821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] use_json = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.074821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] use_stderr = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.075038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.075151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] use_syslog = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.075268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.075455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 08 02:25:10.075577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.075696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.075810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.075936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076422 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.076879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.077932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.078969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079201 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.079868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080019 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.080821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.081931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082044 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.082939 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.083871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.084929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.085569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.085879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.086329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.086448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.086562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.086675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.086786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.086904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.087962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.088891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.089953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.090977 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.091965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.092913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.093894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.094930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.095971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] auth.external = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.096931 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] auth.password = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] auth.token = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.097885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.098921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] credential.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.099862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.100014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.100143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] auth.external = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.100289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.100416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.100538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.100670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.101815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.101956 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] auth.password = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] auth.token = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.102887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.103944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] credential.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.104891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.105916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.106976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.107192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.107307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.107421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.107543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.107659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.107774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.107888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.108943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.109892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.110945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.111890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.112953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113067 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.113894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.114932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.115992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.116110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.116223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.116359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.116920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.117996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.118974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.119910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.120914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.121942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.122998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.123952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.124891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.125865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.126970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.127889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.128981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.129886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] role.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] role.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.130932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.131977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.132162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.132712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.132836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.132952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.133881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134235 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.134920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135384 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135501 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] role.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] role.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.135844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.136954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137651 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.137996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.138933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.139887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.140951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.141996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.142926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143271 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.connection = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.143851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.144935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145430 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.145903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.146949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.147062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.147184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.147300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.147422 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.connection = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.148981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.149942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.150876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.150876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 08 02:25:10.150876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66996) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 08 02:25:10.173515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.173742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.173965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.175142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.175379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.175608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.185143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.186686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.214919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.215155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.216018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.216256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.267801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.268219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.399431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.399671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.404001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.404244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.466052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.466266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.466487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.466573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.466749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.466892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.467109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.467264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.467402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.467536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.467536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.467803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.490750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.490901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.490991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.491163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.491291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.491437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.491569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.491699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.491844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.491986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.492124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.492255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.492386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.492549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.503276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.503450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.516644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.516833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.516982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.517115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.517244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.517385 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.517511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.517637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.517761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.517921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.518063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.518188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.518313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66996) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.518449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66995) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 08 02:25:10.534856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.535065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:25:10.535402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.535530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.535657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:25:10.535782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:25:10.535908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.536076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.536203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.536328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 08 02:25:10.536463 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.536596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.536729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.536853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.536978 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.537171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.547087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.547361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.547627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.547852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.548146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.548412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.548882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.549724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.557829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.558761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.561010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.561284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.561559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.561832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.561958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.562090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.562229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.562358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.562496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.562625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.562753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.562881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.563009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.563143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.563271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.563398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.563528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.563747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.564048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.564317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.564669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.565320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.591379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.591598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.592949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.593195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.593278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.593468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.598480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.598728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.598810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.598997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.599078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.599267 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.606414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.606513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.606692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.606773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.611056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.611168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.611338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.611446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.611618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.611722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.611898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.612019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.612297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.612377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.612573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.612657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.612844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.612926 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.613115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.613195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.631631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.631803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.631952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.632641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.636942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.637175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.640526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.640686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.640809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.640975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.645627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.645838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.649515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.649612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.653145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.653230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.653435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.653538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.653711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.653793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.653988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.654070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.654260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.654343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.654530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.654612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.673308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.673495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.673576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.673650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.673828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.673911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.674083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.674174 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.682688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.682788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.684359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.684446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.684628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.684709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.687546 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.687628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.687820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.687909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.688121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.688203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.688401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.688493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.688677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.688767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.702178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.702322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.702449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.702596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.702722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.702873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.702992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.703149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.703263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.703426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.703527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.703694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.703794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.703984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.721526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.721739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.724657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.724897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.727833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.728238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.729393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.729772 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.730942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.731214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.731337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.731495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.731609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.731894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.738637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.739081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.740210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.740669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.743812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.744109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.744386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.744483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.744661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.744809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.744947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.745227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.753587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.753865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.754143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.754223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.754498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.754779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.761935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66995) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.762252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.762563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.762643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66996) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 08 02:25:10.762835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.762929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.763981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.764167 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.764249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.764427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.764509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.764702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.764782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.764953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.765042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.765272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.765352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.765529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.765618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66995) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.765895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.766155 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66996) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 08 02:25:10.802913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55684cef89c0 pid: 66995 (default app) Apr 08 02:25:10.805283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55684cef89c0 pid: 66996 (default app) Apr 08 02:25:10.807784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898541f-090d-4e1a-8d6f-aa1442d4f3e4 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:10.808113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898541f-090d-4e1a-8d6f-aa1442d4f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:10.808410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898541f-090d-4e1a-8d6f-aa1442d4f3e4 None None] PATH_INFO: `/v3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:10.812524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Fri Apr 8 02:25:10 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:18.206792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8ad21-4e89-4cb8-bbb5-6d2383a9191a None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:18.207355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8ad21-4e89-4cb8-bbb5-6d2383a9191a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:18.207355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8ad21-4e89-4cb8-bbb5-6d2383a9191a None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:18.212685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:25:18.217838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:18.218242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:18.218414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:18.257287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG oslo_db.sqlalchemy.engines [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:25:18.410394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG passlib.handlers.bcrypt [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66995) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 08 02:25:18.410895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG passlib.handlers.bcrypt [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66995) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 08 02:25:18.472051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:18.473571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:18.608743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:18.766301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8ad21-4e89-4cb8-bbb5-6d2383a9191a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:18.810187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG oslo_db.sqlalchemy.engines [None req-2de8ad21-4e89-4cb8-bbb5-6d2383a9191a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66996) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Apr 08 02:25:18.907154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8ad21-4e89-4cb8-bbb5-6d2383a9191a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:18.911099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b23d4-86d7-4e2a-ad6e-7b35f18b558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:18.911684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b23d4-86d7-4e2a-ad6e-7b35f18b558e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:18.912000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b23d4-86d7-4e2a-ad6e-7b35f18b558e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:18.912308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b23d4-86d7-4e2a-ad6e-7b35f18b558e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:18.921420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b23d4-86d7-4e2a-ad6e-7b35f18b558e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:18.974216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b53b23d4-86d7-4e2a-ad6e-7b35f18b558e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 08 02:25:18.974548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b23d4-86d7-4e2a-ad6e-7b35f18b558e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:18.985805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:25:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:25:18.992836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:19.004120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e3113-cc7b-4eaf-993f-1dad16c65351 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:19.008419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b550dc-dec1-4b11-b966-0c20b1957f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:19.009513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b550dc-dec1-4b11-b966-0c20b1957f0e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:19.009813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b550dc-dec1-4b11-b966-0c20b1957f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:19.010107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b550dc-dec1-4b11-b966-0c20b1957f0e admin admin] PATH_INFO: `/v3/projects/34ddce90037c4fbb82757aded33c6c12` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:19.011486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b550dc-dec1-4b11-b966-0c20b1957f0e admin admin] RBAC: Authorizing `identity:get_project(project_id=34ddce90037c4fbb82757aded33c6c12)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:19.063171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.common.rbac_enforcer.enforcer [None req-48b550dc-dec1-4b11-b966-0c20b1957f0e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 08 02:25:19.063460 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b550dc-dec1-4b11-b966-0c20b1957f0e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:19.067914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:25:18 2022] GET /identity/v3/projects/34ddce90037c4fbb82757aded33c6c12 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:21.194523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594114-bc22-43d0-a1e6-185c5e6f3180 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:21.195097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594114-bc22-43d0-a1e6-185c5e6f3180 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:21.195201 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b594114-bc22-43d0-a1e6-185c5e6f3180 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:21.199557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:25:21.205289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e760b65-d16f-4038-a682-931b00f78dd3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:21.205724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e760b65-d16f-4038-a682-931b00f78dd3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:21.205880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e760b65-d16f-4038-a682-931b00f78dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:21.229832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-7e760b65-d16f-4038-a682-931b00f78dd3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:21.231354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7e760b65-d16f-4038-a682-931b00f78dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:21.238656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:21 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:21.260879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594114-bc22-43d0-a1e6-185c5e6f3180 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:21.272575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b594114-bc22-43d0-a1e6-185c5e6f3180 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:21.277074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5fadb-e47a-4b46-a6ac-e75e68b68b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:21.277676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fadb-e47a-4b46-a6ac-e75e68b68b2d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:21.277972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fadb-e47a-4b46-a6ac-e75e68b68b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:21.278260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fadb-e47a-4b46-a6ac-e75e68b68b2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:21.286100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5fadb-e47a-4b46-a6ac-e75e68b68b2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:21.287872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5fadb-e47a-4b46-a6ac-e75e68b68b2d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:21.297217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:25:21 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:25:21.302869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e760b65-d16f-4038-a682-931b00f78dd3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:21.312129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e760b65-d16f-4038-a682-931b00f78dd3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:21.316422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6882c03-f3c8-46e3-89d6-ccfd08d95577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:21.317224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6882c03-f3c8-46e3-89d6-ccfd08d95577 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:21.317517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6882c03-f3c8-46e3-89d6-ccfd08d95577 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:21.317803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6882c03-f3c8-46e3-89d6-ccfd08d95577 admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:21.319142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6882c03-f3c8-46e3-89d6-ccfd08d95577 admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:21.321084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6882c03-f3c8-46e3-89d6-ccfd08d95577 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:21.322544 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:21 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:23.512481 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661e75-64a9-4c15-a693-a5ebd96a82aa None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:23.512967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661e75-64a9-4c15-a693-a5ebd96a82aa None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:23.513076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661e75-64a9-4c15-a693-a5ebd96a82aa None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:23.514731 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:23.519862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e5026-b449-456a-a340-7c68b2c7e2f3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:23.520334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e5026-b449-456a-a340-7c68b2c7e2f3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:23.520523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e5026-b449-456a-a340-7c68b2c7e2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:23.542521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-cf0e5026-b449-456a-a340-7c68b2c7e2f3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:23.543663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cf0e5026-b449-456a-a340-7c68b2c7e2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:23.550403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:23.574006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661e75-64a9-4c15-a693-a5ebd96a82aa None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:23.585729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661e75-64a9-4c15-a693-a5ebd96a82aa None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:23.589765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:23.590478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:23.590776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:23.591069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:23.603778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:23.610154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:25:23.611269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 6/12] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:25:23.616676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e5026-b449-456a-a340-7c68b2c7e2f3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:23.625685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e5026-b449-456a-a340-7c68b2c7e2f3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:23.629770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:23.630357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:23.630650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:23.630937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:23.631647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:23.631979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:23.633920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:23.633920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:25:23.633920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:25:23.634807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:23.645466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 7/13] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:23.650712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:23.660329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307c5d7-e87d-4c75-9b74-0132e478176c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:23.665002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:23.665776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:23.666074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:23.666362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:23.667907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:23.669755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:23.671167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:23 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:23.675790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:23.685380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083d0d-b071-4cfc-87a1-9e61dddfb5cf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:23.689425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908abe1-ae8e-490d-a912-c114090d6248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:23.690121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908abe1-ae8e-490d-a912-c114090d6248 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:23.690412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908abe1-ae8e-490d-a912-c114090d6248 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:23.690698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908abe1-ae8e-490d-a912-c114090d6248 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:23.691773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908abe1-ae8e-490d-a912-c114090d6248 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:23.693465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908abe1-ae8e-490d-a912-c114090d6248 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:23.694831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:23.700975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:23.709984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baab86-842a-41a5-b6d3-64bac039b38f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:23.715071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:23.715627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:23.715917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:23.716236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:23.717006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.domain.id=default, user.id=c7f64b1e79994a23a6fbc99fe8cef153) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:23.717310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:23.719007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:23.719007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:25:23.719007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:25:23.720192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826cf49-886b-45c2-af65-5f052f086ace admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:23.727095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1343 bytes} [Fri Apr 8 02:25:23 2022] GET /identity/v3/role_assignments?user.id=c7f64b1e79994a23a6fbc99fe8cef153&scope.domain.id=default&role.id=3224d4d734484fac94d0c30f0093a334 => generated 233 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:25.801566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa8095-b894-4420-9bc8-42ca32a110ba None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:25.802082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa8095-b894-4420-9bc8-42ca32a110ba None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:25.802082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa8095-b894-4420-9bc8-42ca32a110ba None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:25.804778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 9/17] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:25.810086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:25.810500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:25.810666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:25.842484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG passlib.handlers.bcrypt [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66996) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 08 02:25:25.842910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG passlib.handlers.bcrypt [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66996) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 08 02:25:25.889570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:25.891091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:25.927510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 9/18] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:25.951343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa8095-b894-4420-9bc8-42ca32a110ba None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:25.963679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa8095-b894-4420-9bc8-42ca32a110ba None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:25.967624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:25.968361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:25.968652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:25.968931 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:25.980988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:25.987276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:25:25.988407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:25:25.994768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:26.004949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372b2bb-3417-4f57-a273-b7c960476d07 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:26.009179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:26.010073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:26.010370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:26.010658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:26.011518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:26.011822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:26.012874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:26.012874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:25:26.012874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:25:26.013787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:26.023277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:25:26.028919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:26.038506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851d3ce-39c5-4577-b144-4bc705524a1a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:26.044233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:26.045147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:26.045657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:26.046153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:26.047555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:26.049409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:26.050834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:26 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:26.057136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:26.066591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bef267-7537-4de0-8b31-3bf9c6b9cdf8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:26.070776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d478e78-8dd2-4b87-9c64-83232d35a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:26.071489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d478e78-8dd2-4b87-9c64-83232d35a88d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:26.071786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d478e78-8dd2-4b87-9c64-83232d35a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:26.072113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d478e78-8dd2-4b87-9c64-83232d35a88d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:26.073403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d478e78-8dd2-4b87-9c64-83232d35a88d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:26.075101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d478e78-8dd2-4b87-9c64-83232d35a88d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:26.076541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 11/22] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:26.081624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:26.090775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e8a7-6b7e-4af2-98a9-af6e1534caae admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:26.094825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed4e81-f5f7-4a2b-ae6f-523aaa63e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:26.095605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed4e81-f5f7-4a2b-ae6f-523aaa63e9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:26.095899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed4e81-f5f7-4a2b-ae6f-523aaa63e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:26.096224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed4e81-f5f7-4a2b-ae6f-523aaa63e9d6 admin admin] PATH_INFO: `/v3/domains/default/users/c7f64b1e79994a23a6fbc99fe8cef153/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:26.098017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed4e81-f5f7-4a2b-ae6f-523aaa63e9d6 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c7f64b1e79994a23a6fbc99fe8cef153, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:26.098993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-06ed4e81-f5f7-4a2b-ae6f-523aaa63e9d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:26.098993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:25:26.098993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:25:26.101002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed4e81-f5f7-4a2b-ae6f-523aaa63e9d6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:26.306124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1382 bytes} [Fri Apr 8 02:25:26 2022] PUT /identity/v3/domains/default/users/c7f64b1e79994a23a6fbc99fe8cef153/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:25:28.447830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f02d04-bd77-4cf9-afcb-777dab6c304a None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:28.448425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f02d04-bd77-4cf9-afcb-777dab6c304a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:28.448425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f02d04-bd77-4cf9-afcb-777dab6c304a None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:28.450100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:28.455913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de24c-e9ec-4c3e-91a5-9390fd4c7c00 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:28.456356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de24c-e9ec-4c3e-91a5-9390fd4c7c00 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:28.456527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de24c-e9ec-4c3e-91a5-9390fd4c7c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:28.480968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b26de24c-e9ec-4c3e-91a5-9390fd4c7c00 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:28.482437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b26de24c-e9ec-4c3e-91a5-9390fd4c7c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:28.549824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:28 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:25:28.573729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f02d04-bd77-4cf9-afcb-777dab6c304a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:28.585858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f02d04-bd77-4cf9-afcb-777dab6c304a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:28.589921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:28.590636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:28.590930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:28.591219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:28.603259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:28.609670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:25:28.610802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 13/26] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:25:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:25:28.616608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26de24c-e9ec-4c3e-91a5-9390fd4c7c00 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:28.625179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26de24c-e9ec-4c3e-91a5-9390fd4c7c00 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:28.629234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:28.629822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:28.630117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:28.630405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:28.631121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:28.631425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:28.633363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:28.644443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 14/27] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:28.650436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:28.659591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546dfb-0aa9-4d21-9a18-085099707af2 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:28.664342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:28.665303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:28.665596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:28.665882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:28.667186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:28.669032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:28.670436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:28 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:28.675266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:28.684902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d061-9ed9-4bd2-a6e3-0b49c30e2e2e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:28.689087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b8652-f297-460b-8222-ae9f39557e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:28.689792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b8652-f297-460b-8222-ae9f39557e5f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:28.690090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b8652-f297-460b-8222-ae9f39557e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:28.690378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b8652-f297-460b-8222-ae9f39557e5f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:28.691455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b8652-f297-460b-8222-ae9f39557e5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:28.693161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b8652-f297-460b-8222-ae9f39557e5f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:28.694571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 15/29] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:28.699908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:28.709521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f183ade-f0a5-4dd5-a430-f4c1d67e49dc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:28.714308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5af13-209a-425c-a806-1e189e84d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:28.714879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5af13-209a-425c-a806-1e189e84d40d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:28.715172 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5af13-209a-425c-a806-1e189e84d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:28.715460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5af13-209a-425c-a806-1e189e84d40d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:28.716274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5af13-209a-425c-a806-1e189e84d40d admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.domain.id=default, user.id=c7f64b1e79994a23a6fbc99fe8cef153) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:28.716579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5af13-209a-425c-a806-1e189e84d40d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:28.718426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5af13-209a-425c-a806-1e189e84d40d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:28.724539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1343 bytes} [Fri Apr 8 02:25:28 2022] GET /identity/v3/role_assignments?user.id=c7f64b1e79994a23a6fbc99fe8cef153&scope.domain.id=default&role.id=3224d4d734484fac94d0c30f0093a334 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:30.890817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257417f-1a71-4e4b-bdee-f97a4e84d448 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:30.891331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257417f-1a71-4e4b-bdee-f97a4e84d448 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:30.891429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257417f-1a71-4e4b-bdee-f97a4e84d448 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:30.893106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 16/31] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:25:30.899237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7c3f-b923-4f96-a2f1-6a3cca5cae4c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:30.899602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7c3f-b923-4f96-a2f1-6a3cca5cae4c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:30.899811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b7c3f-b923-4f96-a2f1-6a3cca5cae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:30.923165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-9e7b7c3f-b923-4f96-a2f1-6a3cca5cae4c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:30.924364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9e7b7c3f-b923-4f96-a2f1-6a3cca5cae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:30.931974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:30.954029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257417f-1a71-4e4b-bdee-f97a4e84d448 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:30.966259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257417f-1a71-4e4b-bdee-f97a4e84d448 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:30.970181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b98b5-ecbe-4d8f-9c35-7cccccc3d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:30.970751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b98b5-ecbe-4d8f-9c35-7cccccc3d874 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:30.971045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b98b5-ecbe-4d8f-9c35-7cccccc3d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:30.971334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b98b5-ecbe-4d8f-9c35-7cccccc3d874 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:30.979409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b98b5-ecbe-4d8f-9c35-7cccccc3d874 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:30.981190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b98b5-ecbe-4d8f-9c35-7cccccc3d874 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:30.989357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 17/33] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:25:30 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:25:30.994991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b7c3f-b923-4f96-a2f1-6a3cca5cae4c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:31.003294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b7c3f-b923-4f96-a2f1-6a3cca5cae4c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:31.007787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a53f2d-8086-447f-8057-c62466423b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:31.008541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a53f2d-8086-447f-8057-c62466423b8a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:31.008834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a53f2d-8086-447f-8057-c62466423b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:31.009125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a53f2d-8086-447f-8057-c62466423b8a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:31.010200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a53f2d-8086-447f-8057-c62466423b8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:31.011895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a53f2d-8086-447f-8057-c62466423b8a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:31.013321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 17/34] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:33.182054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631228-3407-4082-946d-71034a717ae2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:33.182576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631228-3407-4082-946d-71034a717ae2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:33.182658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631228-3407-4082-946d-71034a717ae2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:33.184318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 18/35] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:33.189407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c50e8-c754-41b3-828f-bf87633ba814 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:33.189778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c50e8-c754-41b3-828f-bf87633ba814 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:33.189997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c50e8-c754-41b3-828f-bf87633ba814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:33.212414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8e0c50e8-c754-41b3-828f-bf87633ba814 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:33.213573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8e0c50e8-c754-41b3-828f-bf87633ba814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:33.220470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 18/36] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:25:33.243370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab631228-3407-4082-946d-71034a717ae2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:33.254913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab631228-3407-4082-946d-71034a717ae2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:33.259589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:33.260322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:33.260617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:33.260902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:33.272064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:33.273963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:33.290225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:25:33.291272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 19/37] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:25:33.296897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c50e8-c754-41b3-828f-bf87633ba814 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:33.306176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c50e8-c754-41b3-828f-bf87633ba814 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:33.310313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:33.310899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:33.311197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:33.311488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:33.312217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:33.312525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:33.313528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:33.313528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:25:33.313528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:25:33.314439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf4307-72b3-4be7-b684-5bd69381011a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:33.330197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:25:33.335567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:33.345089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cd4cd-3b5b-4548-8f0d-7afd5b4c0ac9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:33.349244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915419b-74a3-46ca-afd4-9b56ae1a9ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:33.349830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915419b-74a3-46ca-afd4-9b56ae1a9ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:33.350126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915419b-74a3-46ca-afd4-9b56ae1a9ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:33.350444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915419b-74a3-46ca-afd4-9b56ae1a9ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:33.351356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915419b-74a3-46ca-afd4-9b56ae1a9ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:33.352426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-a915419b-74a3-46ca-afd4-9b56ae1a9ab9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:33.352426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:25:33.352426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:25:33.353626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915419b-74a3-46ca-afd4-9b56ae1a9ab9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:33.380731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:25:33 2022] POST /identity/v3/projects => generated 301 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:25:35.618099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66671dd-cf3d-4226-9f83-11b16be87ae8 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:35.618629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66671dd-cf3d-4226-9f83-11b16be87ae8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:35.618717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66671dd-cf3d-4226-9f83-11b16be87ae8 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:35.620374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 20/40] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:35.625660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecafb5-a027-47a4-91a3-624aa872401a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:35.626061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecafb5-a027-47a4-91a3-624aa872401a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:35.626242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecafb5-a027-47a4-91a3-624aa872401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:35.648560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-4cecafb5-a027-47a4-91a3-624aa872401a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:35.649707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4cecafb5-a027-47a4-91a3-624aa872401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:35.713590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 21/41] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:35.736071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66671dd-cf3d-4226-9f83-11b16be87ae8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:35.748130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66671dd-cf3d-4226-9f83-11b16be87ae8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:35.752032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256fde0-d484-4632-938b-d247460acf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:35.752614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256fde0-d484-4632-938b-d247460acf4b admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:35.752906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256fde0-d484-4632-938b-d247460acf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:35.753190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256fde0-d484-4632-938b-d247460acf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:35.753887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256fde0-d484-4632-938b-d247460acf4b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:35.754881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-b256fde0-d484-4632-938b-d247460acf4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:35.754881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:25:35.754881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:25:35.755782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256fde0-d484-4632-938b-d247460acf4b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:35.975000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:25:35 2022] POST /identity/v3/roles => generated 219 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:25:38.200005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10687433-6c2b-476f-a2ad-3434e980b692 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:38.200522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10687433-6c2b-476f-a2ad-3434e980b692 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:38.200605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10687433-6c2b-476f-a2ad-3434e980b692 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:38.202247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 22/43] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:38.207693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5035-d2ee-46a3-8225-225ae05a5783 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:38.208105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5035-d2ee-46a3-8225-225ae05a5783 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:38.208331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5035-d2ee-46a3-8225-225ae05a5783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:38.231717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a8ac5035-d2ee-46a3-8225-225ae05a5783 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:38.233271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a8ac5035-d2ee-46a3-8225-225ae05a5783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:38.240395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 22/44] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:38 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:38.262720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10687433-6c2b-476f-a2ad-3434e980b692 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:38.274853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10687433-6c2b-476f-a2ad-3434e980b692 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:38.278766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0f8e4-5a45-4b47-8ded-cf547d86ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:38.279345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f8e4-5a45-4b47-8ded-cf547d86ef2c admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:38.279635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f8e4-5a45-4b47-8ded-cf547d86ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:38.279944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f8e4-5a45-4b47-8ded-cf547d86ef2c admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:38.280674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0f8e4-5a45-4b47-8ded-cf547d86ef2c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:38.281670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-71f0f8e4-5a45-4b47-8ded-cf547d86ef2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:38.281670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:25:38.281670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:25:38.282700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0f8e4-5a45-4b47-8ded-cf547d86ef2c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:38.296767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:25:38 2022] POST /identity/v3/roles => generated 225 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:25:40.499566 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85151a-c450-4485-81ea-f7c7e45641cf None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:40.500086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85151a-c450-4485-81ea-f7c7e45641cf None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:40.500217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85151a-c450-4485-81ea-f7c7e45641cf None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:40.501904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 23/46] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:40.507059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31cac-e9da-4f14-b547-1ae5ccbd1cf0 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:40.508097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31cac-e9da-4f14-b547-1ae5ccbd1cf0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:40.508097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e31cac-e9da-4f14-b547-1ae5ccbd1cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:40.530397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-74e31cac-e9da-4f14-b547-1ae5ccbd1cf0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:40.531663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-74e31cac-e9da-4f14-b547-1ae5ccbd1cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:40.539465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 24/47] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:40.562274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85151a-c450-4485-81ea-f7c7e45641cf None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:40.574123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85151a-c450-4485-81ea-f7c7e45641cf None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:40.578139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016c560-f6bf-4146-a634-b0cebedb698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:40.578727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c560-f6bf-4146-a634-b0cebedb698a admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:40.579028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c560-f6bf-4146-a634-b0cebedb698a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:40.579324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c560-f6bf-4146-a634-b0cebedb698a admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:40.580076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016c560-f6bf-4146-a634-b0cebedb698a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:40.581871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016c560-f6bf-4146-a634-b0cebedb698a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:40.594447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 24/48] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:25:40 2022] POST /identity/v3/roles => generated 223 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:25:42.723208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992faf72-af74-4715-8df6-87faf12f0d59 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:42.723785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992faf72-af74-4715-8df6-87faf12f0d59 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:42.723785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992faf72-af74-4715-8df6-87faf12f0d59 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:42.725496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 25/49] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:42.731256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ad846-7db4-4c7f-bb31-2e9ef48a33eb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:42.731641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ad846-7db4-4c7f-bb31-2e9ef48a33eb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:42.731851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ad846-7db4-4c7f-bb31-2e9ef48a33eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:42.754092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e89ad846-7db4-4c7f-bb31-2e9ef48a33eb None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:42.755178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e89ad846-7db4-4c7f-bb31-2e9ef48a33eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:42.762084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 25/50] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:42.784962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992faf72-af74-4715-8df6-87faf12f0d59 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:42.796740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992faf72-af74-4715-8df6-87faf12f0d59 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:42.800712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f658d2-8b0d-435d-9ce3-4ebac3099e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:42.801420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f658d2-8b0d-435d-9ce3-4ebac3099e60 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:42.801714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f658d2-8b0d-435d-9ce3-4ebac3099e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:42.802004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f658d2-8b0d-435d-9ce3-4ebac3099e60 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:42.803337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f658d2-8b0d-435d-9ce3-4ebac3099e60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:42.805591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f658d2-8b0d-435d-9ce3-4ebac3099e60 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:42.807013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 26/51] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:42.812147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ad846-7db4-4c7f-bb31-2e9ef48a33eb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:42.820757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ad846-7db4-4c7f-bb31-2e9ef48a33eb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:42.824836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dc6e9-bc23-4830-9bc6-3cbed33edc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:42.825419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc6e9-bc23-4830-9bc6-3cbed33edc3c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:42.825716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc6e9-bc23-4830-9bc6-3cbed33edc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:42.826009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dc6e9-bc23-4830-9bc6-3cbed33edc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:42.826657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc6e9-bc23-4830-9bc6-3cbed33edc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:42.827659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-c47dc6e9-bc23-4830-9bc6-3cbed33edc3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:42.827659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:25:42.827659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:25:42.828897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dc6e9-bc23-4830-9bc6-3cbed33edc3c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:42.857178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:25:42 2022] POST /identity/v3/projects => generated 312 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:25:44.979353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53541-f4b9-4551-b082-8e695b89b383 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:44.979895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53541-f4b9-4551-b082-8e695b89b383 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:44.980032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f53541-f4b9-4551-b082-8e695b89b383 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:44.981651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 27/53] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:44.986947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cb19e-4973-41fc-9118-e9c5f7e6cf28 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:44.987352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cb19e-4973-41fc-9118-e9c5f7e6cf28 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:44.987531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cb19e-4973-41fc-9118-e9c5f7e6cf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:45.010197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-656cb19e-4973-41fc-9118-e9c5f7e6cf28 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:45.011367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-656cb19e-4973-41fc-9118-e9c5f7e6cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:45.078522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 27/54] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:25:45.102894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f53541-f4b9-4551-b082-8e695b89b383 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:45.114487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f53541-f4b9-4551-b082-8e695b89b383 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:45.118692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eea6d6-65f7-45cd-8c95-8bf98b28ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:45.119408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea6d6-65f7-45cd-8c95-8bf98b28ab71 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:45.119705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea6d6-65f7-45cd-8c95-8bf98b28ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:45.120020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eea6d6-65f7-45cd-8c95-8bf98b28ab71 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:45.121096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eea6d6-65f7-45cd-8c95-8bf98b28ab71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:45.122794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eea6d6-65f7-45cd-8c95-8bf98b28ab71 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:45.124257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:45.129358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cb19e-4973-41fc-9118-e9c5f7e6cf28 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:45.137856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cb19e-4973-41fc-9118-e9c5f7e6cf28 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:45.141972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c85f8-0da8-4488-85e1-803bcfecb96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:45.142558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c85f8-0da8-4488-85e1-803bcfecb96b admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:45.142862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c85f8-0da8-4488-85e1-803bcfecb96b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:45.143157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c85f8-0da8-4488-85e1-803bcfecb96b admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:45.143823 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c85f8-0da8-4488-85e1-803bcfecb96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:45.145783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c85f8-0da8-4488-85e1-803bcfecb96b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:45.171510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 28/56] 10.222.0.23 () {60 vars in 1161 bytes} [Fri Apr 8 02:25:45 2022] POST /identity/v3/projects => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:25:47.301602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf4aa-adaa-4028-9342-e993a02ccf80 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:47.302146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf4aa-adaa-4028-9342-e993a02ccf80 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:47.302235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf4aa-adaa-4028-9342-e993a02ccf80 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:47.304691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 29/57] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:47.309964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db0a8-d64c-4fb8-b9f1-455c1d904c00 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:47.310362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db0a8-d64c-4fb8-b9f1-455c1d904c00 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:47.310556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9db0a8-d64c-4fb8-b9f1-455c1d904c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:47.333189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7e9db0a8-d64c-4fb8-b9f1-455c1d904c00 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:47.334337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7e9db0a8-d64c-4fb8-b9f1-455c1d904c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:47.399658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 29/58] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:25:47.423820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf4aa-adaa-4028-9342-e993a02ccf80 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:47.436481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf4aa-adaa-4028-9342-e993a02ccf80 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:47.440361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabbccc-9316-4b9c-8199-af2601cceac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:47.441073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabbccc-9316-4b9c-8199-af2601cceac5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:47.441367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabbccc-9316-4b9c-8199-af2601cceac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:47.441651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabbccc-9316-4b9c-8199-af2601cceac5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:47.442714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabbccc-9316-4b9c-8199-af2601cceac5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:47.444429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cabbccc-9316-4b9c-8199-af2601cceac5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:47.446900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:47.452284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9db0a8-d64c-4fb8-b9f1-455c1d904c00 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:47.460934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9db0a8-d64c-4fb8-b9f1-455c1d904c00 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:47.465048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3c04e-4168-4e85-adc8-aa61c1c86ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:47.465644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c04e-4168-4e85-adc8-aa61c1c86ddb admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:47.465944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c04e-4168-4e85-adc8-aa61c1c86ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:47.466238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c04e-4168-4e85-adc8-aa61c1c86ddb admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:47.466901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3c04e-4168-4e85-adc8-aa61c1c86ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:47.467903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-51b3c04e-4168-4e85-adc8-aa61c1c86ddb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:47.467903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:25:47.467903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:25:47.469237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3c04e-4168-4e85-adc8-aa61c1c86ddb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:47.492559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 30/60] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:25:47 2022] POST /identity/v3/users => generated 275 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:25:50.183469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb688d6-e981-4560-8398-ec250e40245a None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.184050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb688d6-e981-4560-8398-ec250e40245a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.184149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb688d6-e981-4560-8398-ec250e40245a None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.185760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 31/61] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:50.191084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270782a-c5d1-4e7d-9a2b-7d416a595cbe None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.191457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270782a-c5d1-4e7d-9a2b-7d416a595cbe None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.191665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270782a-c5d1-4e7d-9a2b-7d416a595cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.215475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1270782a-c5d1-4e7d-9a2b-7d416a595cbe None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:50.216650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1270782a-c5d1-4e7d-9a2b-7d416a595cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:50.223280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 31/62] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:25:50.245993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb688d6-e981-4560-8398-ec250e40245a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:50.258182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb688d6-e981-4560-8398-ec250e40245a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:50.262161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:50.262869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.263164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.263451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.274641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:50.281038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:25:50.282105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 32/63] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:25:50.287545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270782a-c5d1-4e7d-9a2b-7d416a595cbe None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:50.296211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270782a-c5d1-4e7d-9a2b-7d416a595cbe None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:50.300325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:50.300916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.301214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.301507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.302221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:50.302528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:50.304958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:50.313306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 32/64] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:25:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:50.318375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:50.329061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0a84d-483c-4d02-8580-e9e7d45f62fa admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:50.333150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:50.333939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.334233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.334522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.352405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:50.354550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:50.356041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 33/65] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:50 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:25:50.361789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:50.372430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda3d8-00c3-4dd8-b191-d139681914d8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:50.376465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:50.377038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.377333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.377621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.385904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:50.387647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:50.395893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 33/66] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:25:50 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:25:50.401787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:50.410839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06ce71-2b21-4496-8430-db57919dce2a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:50.415309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bbece-aefa-4b5a-ba58-b4107fbc8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:50.416128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbece-aefa-4b5a-ba58-b4107fbc8f68 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.416424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbece-aefa-4b5a-ba58-b4107fbc8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.416716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbece-aefa-4b5a-ba58-b4107fbc8f68 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.417811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bbece-aefa-4b5a-ba58-b4107fbc8f68 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:50.419841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bbece-aefa-4b5a-ba58-b4107fbc8f68 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:50.421353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 34/67] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:25:50 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:50.426629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:50.435684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c769f7d-0577-4223-a518-a1eb50e386f3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:50.439670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4bc93-e6a1-4be5-a285-a2710c6323ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:50.440269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4bc93-e6a1-4be5-a285-a2710c6323ae admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:50.440564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4bc93-e6a1-4be5-a285-a2710c6323ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:50.440856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4bc93-e6a1-4be5-a285-a2710c6323ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:50.441630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4bc93-e6a1-4be5-a285-a2710c6323ae admin admin] RBAC: Adding query filter params (role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1, user.id=473ad4d219da45e08d7d3ad8b07ae180) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:50.441936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4bc93-e6a1-4be5-a285-a2710c6323ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:50.443753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4bc93-e6a1-4be5-a285-a2710c6323ae admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:50.449570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 34/68] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:25:50 2022] GET /identity/v3/role_assignments?user.id=473ad4d219da45e08d7d3ad8b07ae180&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=042411de09cb47e0a875e39fd1ace847 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:52.514679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837560-ac14-42f0-8259-37cf6ead9668 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:52.515172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837560-ac14-42f0-8259-37cf6ead9668 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:52.515280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837560-ac14-42f0-8259-37cf6ead9668 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:52.516962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 35/69] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:52.521972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907fd6-4c78-4028-b7dd-5b85a7be3aab None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:52.522333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907fd6-4c78-4028-b7dd-5b85a7be3aab None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:52.523199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907fd6-4c78-4028-b7dd-5b85a7be3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:52.545568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-63907fd6-4c78-4028-b7dd-5b85a7be3aab None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:52.546715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-63907fd6-4c78-4028-b7dd-5b85a7be3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:52.553928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 35/70] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:52 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:25:52.576325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b837560-ac14-42f0-8259-37cf6ead9668 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:52.588641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b837560-ac14-42f0-8259-37cf6ead9668 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:52.592632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:52.593349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:52.593647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:52.593939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:52.605608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:52.611992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:25:52.613068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:25:52.618342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63907fd6-4c78-4028-b7dd-5b85a7be3aab None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:52.626719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63907fd6-4c78-4028-b7dd-5b85a7be3aab None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:52.630712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:52.631294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:52.631587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:52.631901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:52.632853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:52.633160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:52.634767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:52.643142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 36/72] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:25:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:52.648829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:52.658409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7b6ed-a6eb-4268-bc16-82c5ac6d0cfb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:52.662492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:52.663842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:52.664247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:52.664545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:52.665676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:52.667824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:52.669284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:52 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:52.674128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:52.683405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3b975-50a2-4a44-bf63-1155ee75ac71 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:52.687402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabc612-8f65-45b5-b539-87c727e70c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:52.688191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc612-8f65-45b5-b539-87c727e70c87 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:52.688490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc612-8f65-45b5-b539-87c727e70c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:52.688780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabc612-8f65-45b5-b539-87c727e70c87 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:52.689857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabc612-8f65-45b5-b539-87c727e70c87 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:52.691878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabc612-8f65-45b5-b539-87c727e70c87 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:52.693409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 37/74] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:25:52 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:52.698336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:52.707339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125cb9d-012e-427d-89f9-9f5163a7a4c2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:52.712256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35fa8-1a8c-45b5-ad05-d19de03b01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:52.713051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35fa8-1a8c-45b5-ad05-d19de03b01a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:52.713352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35fa8-1a8c-45b5-ad05-d19de03b01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:52.713646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35fa8-1a8c-45b5-ad05-d19de03b01a0 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/users/473ad4d219da45e08d7d3ad8b07ae180/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:52.715449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35fa8-1a8c-45b5-ad05-d19de03b01a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa633b97da43ea83a6bfe98cf63dd1, user_id=473ad4d219da45e08d7d3ad8b07ae180, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:52.718143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35fa8-1a8c-45b5-ad05-d19de03b01a0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:52.730626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 38/75] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:25:52 2022] PUT /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/users/473ad4d219da45e08d7d3ad8b07ae180/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:25:54.816211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ae65-a138-48aa-8b07-8d292113c009 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:54.816696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ae65-a138-48aa-8b07-8d292113c009 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:54.816696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6ae65-a138-48aa-8b07-8d292113c009 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:54.818372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 38/76] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:54.824183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76841d15-98f2-4a89-ba3d-89abe4d0f71b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:54.824585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76841d15-98f2-4a89-ba3d-89abe4d0f71b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:54.824780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76841d15-98f2-4a89-ba3d-89abe4d0f71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:54.846775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-76841d15-98f2-4a89-ba3d-89abe4d0f71b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:54.847956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-76841d15-98f2-4a89-ba3d-89abe4d0f71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:54.911656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 39/77] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:54 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:54.935622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ae65-a138-48aa-8b07-8d292113c009 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:54.947811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6ae65-a138-48aa-8b07-8d292113c009 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:54.951776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:54.952526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:54.952827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:54.953117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:54.964286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:54.970717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:25:54.971824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 39/78] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:25:54.977726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76841d15-98f2-4a89-ba3d-89abe4d0f71b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:54.986113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76841d15-98f2-4a89-ba3d-89abe4d0f71b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:54.990088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:54.990672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:54.990966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:54.992296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:54.993023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:54.993331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:54.994949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:55.003196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 40/79] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:25:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:55.009142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:55.018170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c9109-17cd-476f-a2d7-d7ad912641bb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:55.022142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:55.023104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:55.023398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:55.023683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:55.024815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:55.026988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:55.028441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 40/80] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:55 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:25:55.033202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:55.042468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6af03-a001-47df-8e99-7dff0b8708d1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:55.046446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:55.046996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:55.047287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:55.047575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:55.056317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:55.058039 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:55.066188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 41/81] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:25:55 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:25:55.071826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:55.080822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7ba0-55bd-43f3-9096-d2849ea32b36 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:55.084960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cd6b6-4131-4546-95f0-84720c5aa591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:55.085711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd6b6-4131-4546-95f0-84720c5aa591 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:55.086006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd6b6-4131-4546-95f0-84720c5aa591 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:55.086296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cd6b6-4131-4546-95f0-84720c5aa591 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:55.087386 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cd6b6-4131-4546-95f0-84720c5aa591 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:55.089453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cd6b6-4131-4546-95f0-84720c5aa591 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:55.090922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 41/82] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:25:55 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:55.096101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:55.104470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e7e8e-db69-48a1-9460-65abfd16ff9e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:55.108576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:55.109141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:55.109438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:55.109730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:55.110503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] RBAC: Adding query filter params (role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1, user.id=473ad4d219da45e08d7d3ad8b07ae180) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:55.110814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:55.111825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:55.111825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:25:55.111825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:25:55.112997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0145a5-136b-47cf-a878-a67ed5fee9cb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:55.119222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 42/83] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:25:55 2022] GET /identity/v3/role_assignments?user.id=473ad4d219da45e08d7d3ad8b07ae180&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=042411de09cb47e0a875e39fd1ace847 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:57.405701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf7e40-d552-4dd9-bb17-40d8e30a773d None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.406220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf7e40-d552-4dd9-bb17-40d8e30a773d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.406305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf7e40-d552-4dd9-bb17-40d8e30a773d None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.407973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 42/84] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:57.413644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afa7bf-95b4-4efd-886a-45c219ffd22a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.414068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afa7bf-95b4-4efd-886a-45c219ffd22a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.414243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afa7bf-95b4-4efd-886a-45c219ffd22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.437003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-43afa7bf-95b4-4efd-886a-45c219ffd22a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:57.438157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-43afa7bf-95b4-4efd-886a-45c219ffd22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:57.445027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:57 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:25:57.467740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf7e40-d552-4dd9-bb17-40d8e30a773d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:57.479947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf7e40-d552-4dd9-bb17-40d8e30a773d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:57.483937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:57.484691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.484988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.485274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.497371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:57.503724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:25:57.504838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 43/86] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:25:57.511098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afa7bf-95b4-4efd-886a-45c219ffd22a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:57.519738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afa7bf-95b4-4efd-886a-45c219ffd22a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:57.524076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:57.524671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.524972 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.525267 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.525991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:57.526301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:57.527919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:57.536320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 44/87] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:57.542253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:57.551348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02147613-5c3e-4a0a-82fb-86b962653c24 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:57.556603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:57.557384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.557678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.557964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.559062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:57.560931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:57.562345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 44/88] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:57 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:25:57.567524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:57.576614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090a3d-e1b8-425e-82e6-594161ef1ef9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:57.580720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:57.581284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.581586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.581883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.589824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:57.591561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:57.599975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 45/89] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:25:57 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:25:57.605547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:57.614543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88357335-4890-42af-93f7-5ca266c8078a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:57.619394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293b0d-228f-48b4-9e8e-fd27bbabcb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:57.620178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293b0d-228f-48b4-9e8e-fd27bbabcb79 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.620476 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293b0d-228f-48b4-9e8e-fd27bbabcb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.620765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293b0d-228f-48b4-9e8e-fd27bbabcb79 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.621843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293b0d-228f-48b4-9e8e-fd27bbabcb79 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:57.623942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293b0d-228f-48b4-9e8e-fd27bbabcb79 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:57.625423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 45/90] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:25:57 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:57.630617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:57.639000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f547ab-dd02-4894-a2fe-d24391864d28 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:57.643036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7f124-414e-4dbf-a49d-5f89480507a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:57.643589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f124-414e-4dbf-a49d-5f89480507a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:57.643879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f124-414e-4dbf-a49d-5f89480507a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:57.644190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7f124-414e-4dbf-a49d-5f89480507a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:57.644955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f124-414e-4dbf-a49d-5f89480507a7 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1, user.id=c7f64b1e79994a23a6fbc99fe8cef153) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:57.645260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f124-414e-4dbf-a49d-5f89480507a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:57.647057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7f124-414e-4dbf-a49d-5f89480507a7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:57.652271 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 46/91] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:25:57 2022] GET /identity/v3/role_assignments?user.id=c7f64b1e79994a23a6fbc99fe8cef153&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:59.729867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad9e9a-b95f-4b97-a961-cee05720d9fc None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:59.730369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad9e9a-b95f-4b97-a961-cee05720d9fc None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:59.730451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad9e9a-b95f-4b97-a961-cee05720d9fc None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:59.732215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 46/92] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:25:59.737352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b765aef-d2e4-4e0c-916a-021aa35c0ac7 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:59.737749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b765aef-d2e4-4e0c-916a-021aa35c0ac7 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:59.737939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b765aef-d2e4-4e0c-916a-021aa35c0ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:59.764804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5b765aef-d2e4-4e0c-916a-021aa35c0ac7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:25:59.766657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5b765aef-d2e4-4e0c-916a-021aa35c0ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:25:59.775803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 47/93] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:25:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:25:59.798825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad9e9a-b95f-4b97-a961-cee05720d9fc None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:59.811645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad9e9a-b95f-4b97-a961-cee05720d9fc None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:59.815543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:59.816292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:59.816583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:59.816869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:59.828250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:25:59.834505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:25:59.835966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 47/94] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:25:59.841291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b765aef-d2e4-4e0c-916a-021aa35c0ac7 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:59.849780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b765aef-d2e4-4e0c-916a-021aa35c0ac7 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:59.854547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:59.855148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:59.855445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:59.855735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:59.856497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:25:59.856809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:59.858419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:59.867717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 48/95] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:59.872896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:59.882638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d149ff9-d364-4bf8-b824-813c0497f925 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:59.886689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:59.887463 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:59.887754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:59.888078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:59.889176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:59.891021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:59.892484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:25:59 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:59.897634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:59.906619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12111e4d-6a3e-4e57-8a96-43c8df4edb31 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:59.910663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711ea9c-bbf2-4580-9ed4-2763247905fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:59.911427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ea9c-bbf2-4580-9ed4-2763247905fb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:59.911721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ea9c-bbf2-4580-9ed4-2763247905fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:59.912043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711ea9c-bbf2-4580-9ed4-2763247905fb admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:59.913625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711ea9c-bbf2-4580-9ed4-2763247905fb admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:59.915723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711ea9c-bbf2-4580-9ed4-2763247905fb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:59.917285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 49/97] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:25:59 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:25:59.922607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:25:59.932871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062b7bf-72c9-429e-87cf-3fe7185aa5c1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:25:59.936948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03de139-4a2a-4f6b-b341-f870d1b0245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:25:59.937748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de139-4a2a-4f6b-b341-f870d1b0245e admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:25:59.938048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de139-4a2a-4f6b-b341-f870d1b0245e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:25:59.938344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de139-4a2a-4f6b-b341-f870d1b0245e admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/users/c7f64b1e79994a23a6fbc99fe8cef153/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:25:59.940135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03de139-4a2a-4f6b-b341-f870d1b0245e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa633b97da43ea83a6bfe98cf63dd1, user_id=c7f64b1e79994a23a6fbc99fe8cef153, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:25:59.941134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-d03de139-4a2a-4f6b-b341-f870d1b0245e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:25:59.941134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:25:59.941134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:25:59.943112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03de139-4a2a-4f6b-b341-f870d1b0245e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:25:59.956154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 49/98] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:25:59 2022] PUT /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/users/c7f64b1e79994a23a6fbc99fe8cef153/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:26:02.051919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d11e3c-18fc-4033-b3fe-32c9f4016519 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.052458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d11e3c-18fc-4033-b3fe-32c9f4016519 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.052566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d11e3c-18fc-4033-b3fe-32c9f4016519 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.055097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 50/99] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:02.060227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d7e0-a645-4c39-8c32-85008404c3f1 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.060637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d7e0-a645-4c39-8c32-85008404c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.060818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8d7e0-a645-4c39-8c32-85008404c3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.082812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b7a8d7e0-a645-4c39-8c32-85008404c3f1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:02.084000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b7a8d7e0-a645-4c39-8c32-85008404c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:02.145971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 50/100] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:02.173624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d11e3c-18fc-4033-b3fe-32c9f4016519 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:02.186485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d11e3c-18fc-4033-b3fe-32c9f4016519 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:02.190366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:02.191079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.191373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.191660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.202869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:02.209214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:26:02.210417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 51/101] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:02.216036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8d7e0-a645-4c39-8c32-85008404c3f1 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:02.224605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8d7e0-a645-4c39-8c32-85008404c3f1 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:02.229208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:02.229799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.230096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.230389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.231102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:02.231410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:02.233065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:02.241929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:02.246901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:02.255849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be730672-2f9a-4a4c-8f37-57d6efbd1adc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:02.259894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:02.260688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.260979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.261262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.262332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:02.264154 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:02.265555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 52/103] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:02 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:02.270489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:02.280029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72982e-adb5-4caf-a26a-a2b3e959444c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:02.284083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:02.284664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.284961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.285254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.293109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:02.294870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:02.304210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 52/104] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:02 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:02.309143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:02.318119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa128d6-ae5c-416a-b367-0bf2ab3a9a9c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:02.322836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99374975-ba99-472d-8c3a-48ac1232c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:02.323594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99374975-ba99-472d-8c3a-48ac1232c1be admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.323892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99374975-ba99-472d-8c3a-48ac1232c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.324215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99374975-ba99-472d-8c3a-48ac1232c1be admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.325296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99374975-ba99-472d-8c3a-48ac1232c1be admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:02.327311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99374975-ba99-472d-8c3a-48ac1232c1be admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:02.328839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 53/105] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:02 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:02.334159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:02.342493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599809-6c27-41b9-b8b4-3680a698ce19 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:02.346563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07fea1-d3f4-47af-8358-f6d1301f59a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:02.347122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07fea1-d3f4-47af-8358-f6d1301f59a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:02.347421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07fea1-d3f4-47af-8358-f6d1301f59a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:02.347715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07fea1-d3f4-47af-8358-f6d1301f59a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:02.348529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07fea1-d3f4-47af-8358-f6d1301f59a6 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1, user.id=c7f64b1e79994a23a6fbc99fe8cef153) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:02.348849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07fea1-d3f4-47af-8358-f6d1301f59a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:02.350729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07fea1-d3f4-47af-8358-f6d1301f59a6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:02.356304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 53/106] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:02 2022] GET /identity/v3/role_assignments?user.id=c7f64b1e79994a23a6fbc99fe8cef153&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:04.583514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1ef6-2c27-4592-804e-a9e6e4ba6948 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.584048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1ef6-2c27-4592-804e-a9e6e4ba6948 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.584131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee1ef6-2c27-4592-804e-a9e6e4ba6948 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.586578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 54/107] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:04.591744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acddce9-b2b0-47b4-a5b4-a6b72a119c9f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.592171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acddce9-b2b0-47b4-a5b4-a6b72a119c9f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.592364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acddce9-b2b0-47b4-a5b4-a6b72a119c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.614562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1acddce9-b2b0-47b4-a5b4-a6b72a119c9f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:04.615708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1acddce9-b2b0-47b4-a5b4-a6b72a119c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:04.623025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 54/108] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:04 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:04.645495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee1ef6-2c27-4592-804e-a9e6e4ba6948 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:04.657697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee1ef6-2c27-4592-804e-a9e6e4ba6948 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:04.661544 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:04.662263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.662573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.663564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.674571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:04.681879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:04.682952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 55/109] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:04.688762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acddce9-b2b0-47b4-a5b4-a6b72a119c9f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:04.699008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acddce9-b2b0-47b4-a5b4-a6b72a119c9f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:04.703083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:04.703707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.704035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.704329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.705058 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:04.705365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:04.706987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:04.716250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 55/110] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:04.721840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:04.733595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df78e1-c0bd-404a-adaa-d21f64f3bdf6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:04.737564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:04.738354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.738645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.738929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.740035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:04.742597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:04.744054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 56/111] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:04 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:04.749259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:04.758670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ba00c-55fc-4e6b-a8d6-c3faf5898c46 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:04.762704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:04.763278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.763577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.763869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.771496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:04.773921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:04.782167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 56/112] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:04 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:26:04.787358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:04.797140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1dd66-9ddf-47c5-8bd5-328c798f521c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:04.801112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00b72c-7b14-4a13-b267-b5c0b2a40b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:04.801869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00b72c-7b14-4a13-b267-b5c0b2a40b44 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.802163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00b72c-7b14-4a13-b267-b5c0b2a40b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.802450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00b72c-7b14-4a13-b267-b5c0b2a40b44 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.804200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00b72c-7b14-4a13-b267-b5c0b2a40b44 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:04.806217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00b72c-7b14-4a13-b267-b5c0b2a40b44 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:04.807692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 57/113] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:04 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:04.813044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:04.821347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85690244-3a3d-43ba-9c51-d5cf021de38e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:04.825402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b754bb-a53a-4bf5-ae8e-6aeb35cb0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:04.825953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b754bb-a53a-4bf5-ae8e-6aeb35cb0f20 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:04.826248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b754bb-a53a-4bf5-ae8e-6aeb35cb0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:04.826537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b754bb-a53a-4bf5-ae8e-6aeb35cb0f20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:04.827303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b754bb-a53a-4bf5-ae8e-6aeb35cb0f20 admin admin] RBAC: Adding query filter params (role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1, user.id=473ad4d219da45e08d7d3ad8b07ae180) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:04.827610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b754bb-a53a-4bf5-ae8e-6aeb35cb0f20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:04.829439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b754bb-a53a-4bf5-ae8e-6aeb35cb0f20 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:04.835036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 57/114] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:04 2022] GET /identity/v3/role_assignments?user.id=473ad4d219da45e08d7d3ad8b07ae180&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=5469eafdf12343518fe61660749f0e85 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:06.924224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76291d-7fcb-4507-85b0-d3265777f8c6 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:06.924741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76291d-7fcb-4507-85b0-d3265777f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:06.924826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76291d-7fcb-4507-85b0-d3265777f8c6 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:06.926472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 58/115] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:06.932643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4bc8-9f5a-487f-a232-f3489e4ce5e7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:06.933013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4bc8-9f5a-487f-a232-f3489e4ce5e7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:06.933231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4bc8-9f5a-487f-a232-f3489e4ce5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:06.956893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e3ec4bc8-9f5a-487f-a232-f3489e4ce5e7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:06.958027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e3ec4bc8-9f5a-487f-a232-f3489e4ce5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:06.964902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 58/116] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:06.986695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76291d-7fcb-4507-85b0-d3265777f8c6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:06.999056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76291d-7fcb-4507-85b0-d3265777f8c6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:07.003083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:07.003839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:07.004160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:07.004449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:07.017058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:07.023890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:07.025037 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 59/117] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:07.030883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4bc8-9f5a-487f-a232-f3489e4ce5e7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:07.039497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4bc8-9f5a-487f-a232-f3489e4ce5e7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:07.043507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:07.044123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:07.044414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:07.044696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:07.045405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:07.045707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:07.047287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:07.056654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 59/118] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:07.061830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:07.072297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b85fbc-fa1d-49e8-884e-073847a0cee6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:07.076349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:07.077119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:07.077422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:07.077709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:07.078805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:07.080959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:07.082381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 60/119] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:07 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:07.087500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:07.096495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6e83-8b2f-41de-bf38-0360d6a03732 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:07.100478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735abd-9717-4041-a671-372aa138cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:07.101233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735abd-9717-4041-a671-372aa138cf9a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:07.101521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735abd-9717-4041-a671-372aa138cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:07.101803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735abd-9717-4041-a671-372aa138cf9a admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:07.102874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735abd-9717-4041-a671-372aa138cf9a admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:07.104912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735abd-9717-4041-a671-372aa138cf9a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:07.106362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 60/120] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:07 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:07.111391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:07.120725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5481fe7-9759-4999-823b-3f89b1889be4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:07.124799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88693de9-13e4-4610-aff8-b03466b7c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:07.125573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693de9-13e4-4610-aff8-b03466b7c9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:07.125870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693de9-13e4-4610-aff8-b03466b7c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:07.126157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693de9-13e4-4610-aff8-b03466b7c9e5 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/users/473ad4d219da45e08d7d3ad8b07ae180/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:07.128145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693de9-13e4-4610-aff8-b03466b7c9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa633b97da43ea83a6bfe98cf63dd1, user_id=473ad4d219da45e08d7d3ad8b07ae180, role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:07.130724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693de9-13e4-4610-aff8-b03466b7c9e5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:07.142651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:26:07 2022] PUT /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/users/473ad4d219da45e08d7d3ad8b07ae180/roles/5469eafdf12343518fe61660749f0e85 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:26:09.208228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237375e-5e91-4a08-9ed2-d475b6ccbdfb None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.208744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237375e-5e91-4a08-9ed2-d475b6ccbdfb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.208827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237375e-5e91-4a08-9ed2-d475b6ccbdfb None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.211128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 61/122] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:09.216403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834709-1b52-4af6-a8f1-50a80eda343a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.216884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834709-1b52-4af6-a8f1-50a80eda343a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.216971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834709-1b52-4af6-a8f1-50a80eda343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.239389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-68834709-1b52-4af6-a8f1-50a80eda343a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:09.240986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-68834709-1b52-4af6-a8f1-50a80eda343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:09.304988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 62/123] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:09.327699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237375e-5e91-4a08-9ed2-d475b6ccbdfb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:09.340003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237375e-5e91-4a08-9ed2-d475b6ccbdfb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:09.343953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:09.344719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.344996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.345293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.357215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:09.364089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:09.365147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 62/124] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:09.370819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834709-1b52-4af6-a8f1-50a80eda343a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:09.379247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834709-1b52-4af6-a8f1-50a80eda343a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:09.383834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:09.384452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.384749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.385040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.385764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:09.386074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:09.387684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:09.395812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 63/125] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:09.401742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:09.410773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102117-6cb2-481b-bca9-1cf9851ac44f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:09.414845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:09.415613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.415906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.416230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.417327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:09.419449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:09.420896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 63/126] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:09 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:09.425709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:09.435011 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf49511-b4e9-4b7c-9fa3-54731aa57c04 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:09.439013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:09.439580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.439877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.440200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.448364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:09.450100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:09.458413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 64/127] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:09 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:09.464901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:09.474106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3667bc1-aea8-40be-8768-3cc5f1edd900 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:09.478479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29081c-27a8-478b-8632-f658dada36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:09.479251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29081c-27a8-478b-8632-f658dada36b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.479551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29081c-27a8-478b-8632-f658dada36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.479840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29081c-27a8-478b-8632-f658dada36b8 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.480971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29081c-27a8-478b-8632-f658dada36b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:09.483112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29081c-27a8-478b-8632-f658dada36b8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:09.484539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 64/128] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:09 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:09.489944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:09.499593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28f29c-8c11-4a11-8225-a4a9b56191ad admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:09.503641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c6013-34ba-4a4f-ab60-e0ad86262dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:09.504247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6013-34ba-4a4f-ab60-e0ad86262dac admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:09.504545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6013-34ba-4a4f-ab60-e0ad86262dac admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:09.504837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6013-34ba-4a4f-ab60-e0ad86262dac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:09.505613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6013-34ba-4a4f-ab60-e0ad86262dac admin admin] RBAC: Adding query filter params (role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1, user.id=473ad4d219da45e08d7d3ad8b07ae180) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:09.505923 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6013-34ba-4a4f-ab60-e0ad86262dac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:09.508489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c6013-34ba-4a4f-ab60-e0ad86262dac admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:09.513973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 65/129] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:09 2022] GET /identity/v3/role_assignments?user.id=473ad4d219da45e08d7d3ad8b07ae180&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=5469eafdf12343518fe61660749f0e85 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:11.751528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9c2bf-bbf3-4478-920e-6c89767d1906 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.752073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9c2bf-bbf3-4478-920e-6c89767d1906 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.752073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9c2bf-bbf3-4478-920e-6c89767d1906 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.754051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 65/130] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:11.760155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a4510-e839-447b-acdf-cc70887a5518 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.760556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a4510-e839-447b-acdf-cc70887a5518 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.760743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a4510-e839-447b-acdf-cc70887a5518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.782903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-d17a4510-e839-447b-acdf-cc70887a5518 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:11.784072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d17a4510-e839-447b-acdf-cc70887a5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:11.790765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 66/131] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:11.813928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9c2bf-bbf3-4478-920e-6c89767d1906 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:11.826103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9c2bf-bbf3-4478-920e-6c89767d1906 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:11.830095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:11.830813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.831107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.831396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.842951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:11.849382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:11.850521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 66/132] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:11.856047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a4510-e839-447b-acdf-cc70887a5518 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:11.864517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a4510-e839-447b-acdf-cc70887a5518 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:11.868895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:11.869483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.869780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.870068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.870787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:11.871102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:11.872743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:11.881635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 67/133] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:11.886714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:11.896322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbc891-28f5-45f5-9dc2-3f4ee7a608f3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:11.900732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:11.901506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.901800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.902089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.903192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:11.905351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:11.906777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 67/134] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:11 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:11.911651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:11.921297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ed0d7-e74f-49ca-ac38-56ac7880556b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:11.925283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:11.925842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.926138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.926432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.934656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:11.936414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:11.945402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:11 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:11.950492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:11.959500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae347e-64c0-43c4-a509-1eaa5da359a7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:11.963507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949152c-fb45-4b23-b75b-0a608fdb068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:11.964297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949152c-fb45-4b23-b75b-0a608fdb068b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.964594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949152c-fb45-4b23-b75b-0a608fdb068b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.964886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949152c-fb45-4b23-b75b-0a608fdb068b admin admin] PATH_INFO: `/v3/projects/8171955e389f4a1a826c727a9e49cde7` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.965957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949152c-fb45-4b23-b75b-0a608fdb068b admin admin] RBAC: Authorizing `identity:get_project(project_id=8171955e389f4a1a826c727a9e49cde7)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:11.967990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949152c-fb45-4b23-b75b-0a608fdb068b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:11.969464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 68/136] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:11 2022] GET /identity/v3/projects/8171955e389f4a1a826c727a9e49cde7 => generated 312 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:11.974602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:11.983704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18632768-4c33-44e7-aba8-ec5cde02725c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:11.987808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2803cb9-5fba-4a55-9d8e-e743f0db6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:11.988396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803cb9-5fba-4a55-9d8e-e743f0db6b11 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:11.988689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803cb9-5fba-4a55-9d8e-e743f0db6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:11.988973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2803cb9-5fba-4a55-9d8e-e743f0db6b11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:11.989764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803cb9-5fba-4a55-9d8e-e743f0db6b11 admin admin] RBAC: Adding query filter params (role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=8171955e389f4a1a826c727a9e49cde7, user.id=473ad4d219da45e08d7d3ad8b07ae180) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:11.990070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803cb9-5fba-4a55-9d8e-e743f0db6b11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:11.992936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2803cb9-5fba-4a55-9d8e-e743f0db6b11 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:11.998028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 69/137] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:11 2022] GET /identity/v3/role_assignments?user.id=473ad4d219da45e08d7d3ad8b07ae180&scope.project.id=8171955e389f4a1a826c727a9e49cde7&role.id=042411de09cb47e0a875e39fd1ace847 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:14.045291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7feba-3a67-4ec9-b532-bba1287e0e8b None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:14.045874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7feba-3a67-4ec9-b532-bba1287e0e8b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:14.045874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7feba-3a67-4ec9-b532-bba1287e0e8b None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:14.047534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 69/138] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:14.052561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be330b-83d2-405a-80ad-a3f3e2696b94 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:14.053338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be330b-83d2-405a-80ad-a3f3e2696b94 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:14.053526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be330b-83d2-405a-80ad-a3f3e2696b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:14.075939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a6be330b-83d2-405a-80ad-a3f3e2696b94 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:14.077089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a6be330b-83d2-405a-80ad-a3f3e2696b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:14.083784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 70/139] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:14.106353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7feba-3a67-4ec9-b532-bba1287e0e8b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:14.118514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7feba-3a67-4ec9-b532-bba1287e0e8b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:14.122449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:14.123159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:14.123455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:14.123744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:14.134896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:14.141316 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:14.142408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 70/140] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:14.148091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be330b-83d2-405a-80ad-a3f3e2696b94 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:14.156658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be330b-83d2-405a-80ad-a3f3e2696b94 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:14.160717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:14.161310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:14.161605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:14.161895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:14.162610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:14.163411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:14.165044 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:14.173426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 71/141] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:14.179673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:14.189400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75be95-0545-41b0-a01a-645da9890e4e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:14.193440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:14.194419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:14.194820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:14.195118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:14.196284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:14.198766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:14.199876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 71/142] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:14 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:14.205296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:14.214644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9525b95-3f4b-4fc8-9cea-022cbb86c20e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:14.218672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf97dde-45f3-4815-9335-aa6102ca1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:14.219458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97dde-45f3-4815-9335-aa6102ca1e38 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:14.219751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97dde-45f3-4815-9335-aa6102ca1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:14.220074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97dde-45f3-4815-9335-aa6102ca1e38 admin admin] PATH_INFO: `/v3/projects/8171955e389f4a1a826c727a9e49cde7` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:14.221169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf97dde-45f3-4815-9335-aa6102ca1e38 admin admin] RBAC: Authorizing `identity:get_project(project_id=8171955e389f4a1a826c727a9e49cde7)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:14.223201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf97dde-45f3-4815-9335-aa6102ca1e38 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:14.224743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 72/143] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:14 2022] GET /identity/v3/projects/8171955e389f4a1a826c727a9e49cde7 => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:14.230841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:14.240100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f37c-b87e-4f5a-a1cc-da61bc9e470b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:14.245251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e6170-6d49-4740-b617-1cb8d82ad517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:14.246049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6170-6d49-4740-b617-1cb8d82ad517 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:14.246375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6170-6d49-4740-b617-1cb8d82ad517 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:14.246668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6170-6d49-4740-b617-1cb8d82ad517 admin admin] PATH_INFO: `/v3/projects/8171955e389f4a1a826c727a9e49cde7/users/473ad4d219da45e08d7d3ad8b07ae180/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:14.248492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e6170-6d49-4740-b617-1cb8d82ad517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8171955e389f4a1a826c727a9e49cde7, user_id=473ad4d219da45e08d7d3ad8b07ae180, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:14.251111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e6170-6d49-4740-b617-1cb8d82ad517 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:14.262677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 72/144] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:26:14 2022] PUT /identity/v3/projects/8171955e389f4a1a826c727a9e49cde7/users/473ad4d219da45e08d7d3ad8b07ae180/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:26:16.327707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369a1e5-bdb8-4bed-8ddb-02745868f411 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.328299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369a1e5-bdb8-4bed-8ddb-02745868f411 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.328299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369a1e5-bdb8-4bed-8ddb-02745868f411 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.329986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 73/145] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:16.337023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18a59-cda1-42f6-9243-13027491bbce None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.337470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18a59-cda1-42f6-9243-13027491bbce None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.337602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c18a59-cda1-42f6-9243-13027491bbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.359421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d3c18a59-cda1-42f6-9243-13027491bbce None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:16.360664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d3c18a59-cda1-42f6-9243-13027491bbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:16.423626 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 73/146] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:16 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:16.447349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369a1e5-bdb8-4bed-8ddb-02745868f411 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:16.458880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369a1e5-bdb8-4bed-8ddb-02745868f411 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:16.463479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:16.464226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.464525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.464815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.476101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:16.482483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:16.483572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 74/147] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:16.489279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18a59-cda1-42f6-9243-13027491bbce None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:16.498354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c18a59-cda1-42f6-9243-13027491bbce None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:16.502377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:16.502974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.503272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.503564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.504317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] RBAC: Adding query filter params (name=member) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:16.504628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:16.506224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:16.515123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 74/148] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:16.520076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:16.529421 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dead7da-553a-4f2c-aab8-47f6cd0129b6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:16.533388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:16.534171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.534467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.534755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.535845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:16.538209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:16.539630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 75/149] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:16 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:16.544594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:16.554389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b5d5f-a8f3-4ce8-aec5-0d6d16e0beee admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:16.558534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:16.559095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.559392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.559683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.567239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:16.569663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:16.577968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 75/150] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:16 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:16.582939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:16.592039 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd47f69-069b-424c-b4f4-186747f1b31c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:16.596023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d870f-2907-4ecc-beb5-6fee69461e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:16.596773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d870f-2907-4ecc-beb5-6fee69461e14 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.597067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d870f-2907-4ecc-beb5-6fee69461e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.597358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d870f-2907-4ecc-beb5-6fee69461e14 admin admin] PATH_INFO: `/v3/projects/8171955e389f4a1a826c727a9e49cde7` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.598425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d870f-2907-4ecc-beb5-6fee69461e14 admin admin] RBAC: Authorizing `identity:get_project(project_id=8171955e389f4a1a826c727a9e49cde7)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:16.600526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d870f-2907-4ecc-beb5-6fee69461e14 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:16.601995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 76/151] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:16 2022] GET /identity/v3/projects/8171955e389f4a1a826c727a9e49cde7 => generated 312 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:16.607147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:16.615322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f78ce6-effe-4ca2-977e-be490dedab02 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:16.629995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a134a4-63c9-4a91-a7ee-225cb99d5f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:16.632107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a134a4-63c9-4a91-a7ee-225cb99d5f1a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:16.632544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a134a4-63c9-4a91-a7ee-225cb99d5f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:16.632860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a134a4-63c9-4a91-a7ee-225cb99d5f1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:16.633653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a134a4-63c9-4a91-a7ee-225cb99d5f1a admin admin] RBAC: Adding query filter params (role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=8171955e389f4a1a826c727a9e49cde7, user.id=473ad4d219da45e08d7d3ad8b07ae180) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:16.633963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a134a4-63c9-4a91-a7ee-225cb99d5f1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:16.635827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a134a4-63c9-4a91-a7ee-225cb99d5f1a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:16.643008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 76/152] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:16 2022] GET /identity/v3/role_assignments?user.id=473ad4d219da45e08d7d3ad8b07ae180&scope.project.id=8171955e389f4a1a826c727a9e49cde7&role.id=042411de09cb47e0a875e39fd1ace847 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:18.769943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57133e-eff0-40de-9fa8-40a958e7c606 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:18.770458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57133e-eff0-40de-9fa8-40a958e7c606 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:18.770458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57133e-eff0-40de-9fa8-40a958e7c606 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:18.772698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 77/153] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:18.778202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9e4b4-bfb0-451a-88f1-12e641732774 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:18.778618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9e4b4-bfb0-451a-88f1-12e641732774 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:18.778781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9e4b4-bfb0-451a-88f1-12e641732774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:18.801361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-44f9e4b4-bfb0-451a-88f1-12e641732774 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:18.802491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-44f9e4b4-bfb0-451a-88f1-12e641732774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:18.809991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 77/154] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:18.832699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57133e-eff0-40de-9fa8-40a958e7c606 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:18.844930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57133e-eff0-40de-9fa8-40a958e7c606 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:18.848893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3466e89-ca17-46f2-b6a4-e7a41a704476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:18.849617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3466e89-ca17-46f2-b6a4-e7a41a704476 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:18.849909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3466e89-ca17-46f2-b6a4-e7a41a704476 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:18.850768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3466e89-ca17-46f2-b6a4-e7a41a704476 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:18.851856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3466e89-ca17-46f2-b6a4-e7a41a704476 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:18.853577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3466e89-ca17-46f2-b6a4-e7a41a704476 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:18.855021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 78/155] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:18.860045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9e4b4-bfb0-451a-88f1-12e641732774 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:18.868522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9e4b4-bfb0-451a-88f1-12e641732774 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:18.873142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88f6ea-0219-4025-bde6-be0d60408b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:18.873808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f6ea-0219-4025-bde6-be0d60408b12 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:18.874181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f6ea-0219-4025-bde6-be0d60408b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:18.874563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88f6ea-0219-4025-bde6-be0d60408b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:18.875301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88f6ea-0219-4025-bde6-be0d60408b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:18.877330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88f6ea-0219-4025-bde6-be0d60408b12 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:18.903030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 78/156] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:26:18 2022] POST /identity/v3/projects => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:26:21.034988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701dca-c891-4812-be1b-c8ef942496c8 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:21.035526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701dca-c891-4812-be1b-c8ef942496c8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:21.035616 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45701dca-c891-4812-be1b-c8ef942496c8 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:21.037262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 79/157] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:21.042580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ae4e-a827-4f00-8cd5-b487cbdc4ab5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:21.042952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ae4e-a827-4f00-8cd5-b487cbdc4ab5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:21.043150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ae4e-a827-4f00-8cd5-b487cbdc4ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:21.065685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3640ae4e-a827-4f00-8cd5-b487cbdc4ab5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:21.066841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3640ae4e-a827-4f00-8cd5-b487cbdc4ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:21.130299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 79/158] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:21 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:21.154210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45701dca-c891-4812-be1b-c8ef942496c8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:21.165654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45701dca-c891-4812-be1b-c8ef942496c8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:21.169554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1fdf6-f8ef-4598-8cc8-244f0df632de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:21.170253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1fdf6-f8ef-4598-8cc8-244f0df632de admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:21.170545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1fdf6-f8ef-4598-8cc8-244f0df632de admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:21.170825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1fdf6-f8ef-4598-8cc8-244f0df632de admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:21.171880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1fdf6-f8ef-4598-8cc8-244f0df632de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:21.173578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1fdf6-f8ef-4598-8cc8-244f0df632de admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:21.174992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 80/159] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:21.181069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ae4e-a827-4f00-8cd5-b487cbdc4ab5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:21.189714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ae4e-a827-4f00-8cd5-b487cbdc4ab5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:21.193831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143ea1c-8c6b-402a-be40-f98b4eb9e188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:21.194452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143ea1c-8c6b-402a-be40-f98b4eb9e188 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:21.194746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143ea1c-8c6b-402a-be40-f98b4eb9e188 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:21.195034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143ea1c-8c6b-402a-be40-f98b4eb9e188 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:21.195685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143ea1c-8c6b-402a-be40-f98b4eb9e188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:21.197643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143ea1c-8c6b-402a-be40-f98b4eb9e188 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:21.216469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 80/160] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:26:21 2022] POST /identity/v3/users => generated 283 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:26:23.446493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9f2e-488b-4fc0-8de9-96c393c11ee3 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.447043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9f2e-488b-4fc0-8de9-96c393c11ee3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.447128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db9f2e-488b-4fc0-8de9-96c393c11ee3 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.448789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 81/161] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:23.454114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9fa0-a777-49c5-ace1-a16c4534fe95 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.454534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9fa0-a777-49c5-ace1-a16c4534fe95 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.454696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9fa0-a777-49c5-ace1-a16c4534fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.478862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4e9e9fa0-a777-49c5-ace1-a16c4534fe95 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:23.480031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4e9e9fa0-a777-49c5-ace1-a16c4534fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:23.486829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 81/162] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:23.510029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9f2e-488b-4fc0-8de9-96c393c11ee3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:23.522339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db9f2e-488b-4fc0-8de9-96c393c11ee3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:23.526346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:23.527056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.527346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.527626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.539564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:23.545922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:23.547024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 82/163] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:23.552673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e9fa0-a777-49c5-ace1-a16c4534fe95 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:23.561473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e9fa0-a777-49c5-ace1-a16c4534fe95 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:23.565510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:23.566093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.566388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.566674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.567388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:23.567693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:23.569568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:23.577789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 82/164] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:23.582787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:23.592358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656128-2b4a-44e7-9555-26e3ed8f17bf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:23.596325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:23.597090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.597377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.597659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] PATH_INFO: `/v3/users/6c6d4d4d250345d6aad47f0e2e83304e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.615862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4d4d250345d6aad47f0e2e83304e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:23.618019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:23.619495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 83/165] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:23 2022] GET /identity/v3/users/6c6d4d4d250345d6aad47f0e2e83304e => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:23.624645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:23.634380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0b30-14c5-401a-bcdb-98e9b0140252 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:23.638374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:23.638935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.639226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.639510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.647692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:23.649449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:23.657659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 83/166] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:23 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:23.662562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:23.671382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64674a1-810c-42b0-98ff-e48c002959d7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:23.675334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b777-6ee8-4367-b79f-eb0842dc1585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:23.676118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b777-6ee8-4367-b79f-eb0842dc1585 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.676405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b777-6ee8-4367-b79f-eb0842dc1585 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.676683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b777-6ee8-4367-b79f-eb0842dc1585 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.677739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b777-6ee8-4367-b79f-eb0842dc1585 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:23.680076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b777-6ee8-4367-b79f-eb0842dc1585 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:23.681526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 84/167] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:23 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:23.686732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:23.695492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a005887-3127-47d4-86ef-160dd0ff0215 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:23.699526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d391-5a62-448b-bd49-069febea0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:23.700064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d391-5a62-448b-bd49-069febea0112 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:23.700360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d391-5a62-448b-bd49-069febea0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:23.700647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d391-5a62-448b-bd49-069febea0112 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:23.701411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d391-5a62-448b-bd49-069febea0112 admin admin] RBAC: Adding query filter params (role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2, user.id=6c6d4d4d250345d6aad47f0e2e83304e) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:23.701716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d391-5a62-448b-bd49-069febea0112 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:23.703498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d391-5a62-448b-bd49-069febea0112 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:23.708664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 84/168] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:23 2022] GET /identity/v3/role_assignments?user.id=6c6d4d4d250345d6aad47f0e2e83304e&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=042411de09cb47e0a875e39fd1ace847 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:25.772154 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db8542-6a0b-45b8-bd3d-4c27c33a40f1 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:25.772642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db8542-6a0b-45b8-bd3d-4c27c33a40f1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:25.772744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db8542-6a0b-45b8-bd3d-4c27c33a40f1 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:25.774336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 85/169] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:25.779351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040e006-df96-4cf7-b54c-49a3e1154384 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:25.779802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040e006-df96-4cf7-b54c-49a3e1154384 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:25.779944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040e006-df96-4cf7-b54c-49a3e1154384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:25.802127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8040e006-df96-4cf7-b54c-49a3e1154384 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:25.804913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8040e006-df96-4cf7-b54c-49a3e1154384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:25.811639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 85/170] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:25.833670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db8542-6a0b-45b8-bd3d-4c27c33a40f1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:25.845591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db8542-6a0b-45b8-bd3d-4c27c33a40f1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:25.849454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:25.850204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:25.850489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:25.850765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:25.862139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:25.868554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:25.869606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 86/171] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:25.874934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040e006-df96-4cf7-b54c-49a3e1154384 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:25.883899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040e006-df96-4cf7-b54c-49a3e1154384 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:25.887966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:25.888561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:25.888856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:25.889144 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:25.889860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:25.890163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:25.891747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:25.900637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 86/172] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:25.905768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:25.915142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6142a-5698-4d47-afac-a9f96585ec35 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:25.919069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:25.919833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:25.920152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:25.920433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] PATH_INFO: `/v3/users/6c6d4d4d250345d6aad47f0e2e83304e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:25.921500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4d4d250345d6aad47f0e2e83304e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:25.923599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:25.925031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 87/173] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:25 2022] GET /identity/v3/users/6c6d4d4d250345d6aad47f0e2e83304e => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:25.930202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:25.939034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2783ec-a4a7-487b-a3d0-b81d32fed866 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:25.942981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa2870-eca6-49ba-9ba0-63b43ce17056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:25.944318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa2870-eca6-49ba-9ba0-63b43ce17056 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:25.944613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa2870-eca6-49ba-9ba0-63b43ce17056 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:25.944902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa2870-eca6-49ba-9ba0-63b43ce17056 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:25.945979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa2870-eca6-49ba-9ba0-63b43ce17056 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:25.947991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa2870-eca6-49ba-9ba0-63b43ce17056 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:25.949453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 87/174] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:25 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:25.954626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:25.964130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252fec8-a4bc-40cc-b722-76c137d8831d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:25.968074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e442e5-c6d9-4e3a-b69e-0e502c9ad877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:25.968839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e442e5-c6d9-4e3a-b69e-0e502c9ad877 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:25.969123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e442e5-c6d9-4e3a-b69e-0e502c9ad877 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:25.969402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e442e5-c6d9-4e3a-b69e-0e502c9ad877 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/users/6c6d4d4d250345d6aad47f0e2e83304e/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:25.971111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e442e5-c6d9-4e3a-b69e-0e502c9ad877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f49eab4461490fb0e5fea5d6ca05b2, user_id=6c6d4d4d250345d6aad47f0e2e83304e, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:25.973691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e442e5-c6d9-4e3a-b69e-0e502c9ad877 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:25.985241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 88/175] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:26:25 2022] PUT /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/users/6c6d4d4d250345d6aad47f0e2e83304e/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:26:28.085723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a72f-7892-4aa0-b2ef-52fa3747e362 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.086279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a72f-7892-4aa0-b2ef-52fa3747e362 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.086376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1a72f-7892-4aa0-b2ef-52fa3747e362 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.087983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 88/176] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:28.093060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912830-6793-4d85-aa2f-8653ac587781 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.093480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912830-6793-4d85-aa2f-8653ac587781 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.093637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e912830-6793-4d85-aa2f-8653ac587781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.115755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9e912830-6793-4d85-aa2f-8653ac587781 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:28.116930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9e912830-6793-4d85-aa2f-8653ac587781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:28.181256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 89/177] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:28 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:28.204421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1a72f-7892-4aa0-b2ef-52fa3747e362 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:28.216832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1a72f-7892-4aa0-b2ef-52fa3747e362 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:28.220827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:28.221541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.221890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.222186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.233504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:28.239916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:28.241004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 89/178] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:28.246488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e912830-6793-4d85-aa2f-8653ac587781 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:28.254910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e912830-6793-4d85-aa2f-8653ac587781 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:28.260150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:28.260738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.261029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.261314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.262029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:28.262330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:28.263947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:28.273385 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 90/179] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:28.282701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:28.296934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eeb625-1d07-49f3-be45-ffd17933f98e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:28.301957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:28.302749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.303313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.303594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] PATH_INFO: `/v3/users/6c6d4d4d250345d6aad47f0e2e83304e` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.304746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4d4d250345d6aad47f0e2e83304e)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:28.306853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:28.308354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 90/180] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:28 2022] GET /identity/v3/users/6c6d4d4d250345d6aad47f0e2e83304e => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:28.313676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:28.325165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb94c40-20a4-45aa-8d9d-381754964def admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:28.330018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:28.330595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.330885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.331170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.340288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:28.341970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:28.350779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 91/181] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:28 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:28.356418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:28.366188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7009621-ca00-4039-b9c2-a14dbec5aafc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:28.370266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88f2e2-612f-4bf8-a9aa-d01523876fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:28.371042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88f2e2-612f-4bf8-a9aa-d01523876fec admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.371331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88f2e2-612f-4bf8-a9aa-d01523876fec admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.371615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88f2e2-612f-4bf8-a9aa-d01523876fec admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.372721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88f2e2-612f-4bf8-a9aa-d01523876fec admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:28.374742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88f2e2-612f-4bf8-a9aa-d01523876fec admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:28.376246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 91/182] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:28 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:28.382281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:28.390667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240fa50-35e1-4d18-a6a9-898238bd8977 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:28.394705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad8838-ccee-48bc-82ab-fcbc68418c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:28.395275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad8838-ccee-48bc-82ab-fcbc68418c0c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:28.395571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad8838-ccee-48bc-82ab-fcbc68418c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:28.395861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad8838-ccee-48bc-82ab-fcbc68418c0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:28.397380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad8838-ccee-48bc-82ab-fcbc68418c0c admin admin] RBAC: Adding query filter params (role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2, user.id=6c6d4d4d250345d6aad47f0e2e83304e) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:28.397754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad8838-ccee-48bc-82ab-fcbc68418c0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:28.399562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad8838-ccee-48bc-82ab-fcbc68418c0c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:28.405151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 92/183] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:28 2022] GET /identity/v3/role_assignments?user.id=6c6d4d4d250345d6aad47f0e2e83304e&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=042411de09cb47e0a875e39fd1ace847 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:30.650519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a6c7-71ad-494b-a644-8c451b83e6d9 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.651028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a6c7-71ad-494b-a644-8c451b83e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.651140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a6c7-71ad-494b-a644-8c451b83e6d9 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.652784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 92/184] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:30.657812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0828b-a187-4673-9e0a-50140a6490d9 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.658218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0828b-a187-4673-9e0a-50140a6490d9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.658392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0828b-a187-4673-9e0a-50140a6490d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.681122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b9c0828b-a187-4673-9e0a-50140a6490d9 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:30.682278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b9c0828b-a187-4673-9e0a-50140a6490d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:30.689014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 93/185] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:30 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:30.712269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9a6c7-71ad-494b-a644-8c451b83e6d9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:30.723758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9a6c7-71ad-494b-a644-8c451b83e6d9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:30.732013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:30.733673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.733903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.734187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.745653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:30.759057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:26:30.760263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 93/186] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:30.766166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0828b-a187-4673-9e0a-50140a6490d9 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:30.775382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0828b-a187-4673-9e0a-50140a6490d9 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:30.779456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:30.780085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.780380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.780668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.781682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:30.781990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:30.783578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:30.792709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 94/187] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:30.797854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:30.808321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6a93e-b00d-42a5-9dea-c049eb6d4c9e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:30.812252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:30.813027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.813317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.813601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.814684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:30.816515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:30.817930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 94/188] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:30 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:30.823361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:30.832486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6e392-f9e5-4698-ad9f-7eca1d39985d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:30.837543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:30.838106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.838400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.838686 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.846221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:30.847948 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:30.856812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 95/189] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:30 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:30.861791 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:30.870850 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8fd68-95ac-464b-902d-a3f695fb588a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:30.874785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529140f2-b3a9-4b1d-93d6-34e7896f611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:30.875533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529140f2-b3a9-4b1d-93d6-34e7896f611b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.875829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529140f2-b3a9-4b1d-93d6-34e7896f611b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.876145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529140f2-b3a9-4b1d-93d6-34e7896f611b admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.877214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529140f2-b3a9-4b1d-93d6-34e7896f611b admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:30.879202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529140f2-b3a9-4b1d-93d6-34e7896f611b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:30.880694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 95/190] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:30 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:30.886390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:30.894553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447b6cc-1a5f-4afb-afc9-a7c946c1dfe2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:30.899530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f077f-cc70-4fd8-9a3f-d32eaae9bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:30.900119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f077f-cc70-4fd8-9a3f-d32eaae9bd99 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:30.900414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f077f-cc70-4fd8-9a3f-d32eaae9bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:30.900694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f077f-cc70-4fd8-9a3f-d32eaae9bd99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:30.901454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f077f-cc70-4fd8-9a3f-d32eaae9bd99 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2, user.id=c7f64b1e79994a23a6fbc99fe8cef153) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:30.901752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f077f-cc70-4fd8-9a3f-d32eaae9bd99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:30.903808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f077f-cc70-4fd8-9a3f-d32eaae9bd99 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:30.909005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 96/191] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:30 2022] GET /identity/v3/role_assignments?user.id=c7f64b1e79994a23a6fbc99fe8cef153&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:33.013882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38926c9-93a3-48a6-976a-508687d436e5 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:33.014396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38926c9-93a3-48a6-976a-508687d436e5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:33.014507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38926c9-93a3-48a6-976a-508687d436e5 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:33.016778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 96/192] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:33.021762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d544-d0ab-4be5-af1c-25a4482e2b49 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:33.022183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d544-d0ab-4be5-af1c-25a4482e2b49 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:33.022347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38d544-d0ab-4be5-af1c-25a4482e2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:33.044333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6d38d544-d0ab-4be5-af1c-25a4482e2b49 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:33.045484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6d38d544-d0ab-4be5-af1c-25a4482e2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:33.052344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 97/193] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:33.077659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38926c9-93a3-48a6-976a-508687d436e5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:33.089341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38926c9-93a3-48a6-976a-508687d436e5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:33.093255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:33.093967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:33.094262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:33.094547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:33.105552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:33.112020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:26:33.113091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 97/194] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:33.119184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38d544-d0ab-4be5-af1c-25a4482e2b49 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:33.127971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38d544-d0ab-4be5-af1c-25a4482e2b49 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:33.132768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:33.133361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:33.133655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:33.133941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:33.134659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:33.134962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:33.136608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:33.145057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 98/195] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:33.150240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:33.160980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cec73-f7d5-4a86-a2e9-c88577681e4a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:33.165839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:33.166640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:33.166953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:33.167252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:33.168465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:33.170446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:33.171950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 98/196] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:33 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:33.177732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:33.188108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb72b-9fa4-4ce6-bd1c-9b4077cd5d89 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:33.192247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684d89b-499e-4222-8bba-52849ae11f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:33.193028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d89b-499e-4222-8bba-52849ae11f45 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:33.193323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d89b-499e-4222-8bba-52849ae11f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:33.193618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684d89b-499e-4222-8bba-52849ae11f45 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:33.195358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684d89b-499e-4222-8bba-52849ae11f45 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:33.197440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684d89b-499e-4222-8bba-52849ae11f45 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:33.198961 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 99/197] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:33 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:33.204275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:33.213950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ccb17-1c59-4793-8d73-13fc6fe6c078 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:33.218126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a93faa-53c6-4c16-8647-1474cf519445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:33.218930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a93faa-53c6-4c16-8647-1474cf519445 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:33.219223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a93faa-53c6-4c16-8647-1474cf519445 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:33.219510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a93faa-53c6-4c16-8647-1474cf519445 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/users/c7f64b1e79994a23a6fbc99fe8cef153/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:33.221315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a93faa-53c6-4c16-8647-1474cf519445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f49eab4461490fb0e5fea5d6ca05b2, user_id=c7f64b1e79994a23a6fbc99fe8cef153, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:33.223954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a93faa-53c6-4c16-8647-1474cf519445 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:33.236350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 99/198] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:26:33 2022] PUT /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/users/c7f64b1e79994a23a6fbc99fe8cef153/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:26:35.375954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1b9a-c77b-4346-954f-92bb051b644e None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.376502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1b9a-c77b-4346-954f-92bb051b644e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.376592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b1b9a-c77b-4346-954f-92bb051b644e None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.378206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 100/199] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:35.383880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b531-a481-48e8-975f-4c4ca3f21bcf None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.384288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b531-a481-48e8-975f-4c4ca3f21bcf None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.384482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b531-a481-48e8-975f-4c4ca3f21bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.406556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6d07b531-a481-48e8-975f-4c4ca3f21bcf None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:35.407689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6d07b531-a481-48e8-975f-4c4ca3f21bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:35.479989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 100/200] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:35 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:35.502903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b1b9a-c77b-4346-954f-92bb051b644e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:35.515546 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b1b9a-c77b-4346-954f-92bb051b644e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:35.519444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:35.520211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.520503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.520786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.532283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:35.539069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:26:35.540202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 101/201] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:26:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:35.546140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07b531-a481-48e8-975f-4c4ca3f21bcf None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:35.556047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07b531-a481-48e8-975f-4c4ca3f21bcf None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:35.560108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:35.560695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.560982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.561262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.561970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:35.562270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:35.563848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:35.573263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 101/202] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:35.578613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:35.587954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94837548-ca86-4255-aa87-699735becfb2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:35.591956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:35.592762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.593052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.593333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.594433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:35.596268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:35.597716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 102/203] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:35 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:35.603844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:35.613007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0b19-03a2-4477-97d0-7ddbf3bd87ab admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:35.617861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:35.618422 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.618711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.618993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.626797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:35.628526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:35.637269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:35 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:35.642754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:35.651971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa78f-6bb9-41be-ad0d-337ddcae4450 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:35.655891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33840e4e-a73d-48c4-bbfb-fa59464e6836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:35.656693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840e4e-a73d-48c4-bbfb-fa59464e6836 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.656983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840e4e-a73d-48c4-bbfb-fa59464e6836 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.657266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33840e4e-a73d-48c4-bbfb-fa59464e6836 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.658341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33840e4e-a73d-48c4-bbfb-fa59464e6836 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:35.660412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33840e4e-a73d-48c4-bbfb-fa59464e6836 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:35.661908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 103/205] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:35 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:35.668068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:35.676319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487dfeb-66db-4aed-8df7-a802f472926e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:35.680905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc0953-ac63-4ce1-bd0a-4457fd2d475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:35.681469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc0953-ac63-4ce1-bd0a-4457fd2d475e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:35.681760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc0953-ac63-4ce1-bd0a-4457fd2d475e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:35.682046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc0953-ac63-4ce1-bd0a-4457fd2d475e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:35.682812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc0953-ac63-4ce1-bd0a-4457fd2d475e admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2, user.id=c7f64b1e79994a23a6fbc99fe8cef153) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:35.683117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc0953-ac63-4ce1-bd0a-4457fd2d475e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:35.684942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc0953-ac63-4ce1-bd0a-4457fd2d475e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:35.690411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 103/206] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:35 2022] GET /identity/v3/role_assignments?user.id=c7f64b1e79994a23a6fbc99fe8cef153&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:37.941678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cee16-ee33-41f8-81a7-38e257393da6 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:37.942225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cee16-ee33-41f8-81a7-38e257393da6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:37.942225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cee16-ee33-41f8-81a7-38e257393da6 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:37.943898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 104/207] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:37.949757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4f86-2da4-4be0-89c5-973d4e1418e1 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:37.950169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4f86-2da4-4be0-89c5-973d4e1418e1 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:37.950329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4f86-2da4-4be0-89c5-973d4e1418e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:37.972252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-86fc4f86-2da4-4be0-89c5-973d4e1418e1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:37.973485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-86fc4f86-2da4-4be0-89c5-973d4e1418e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:37.980381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 104/208] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:37 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:38.002842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cee16-ee33-41f8-81a7-38e257393da6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:38.014991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cee16-ee33-41f8-81a7-38e257393da6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:38.018885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:38.019607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:38.019897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:38.020216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:38.031864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:38.038793 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:38.039854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 105/209] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:38.045321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc4f86-2da4-4be0-89c5-973d4e1418e1 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:38.053846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc4f86-2da4-4be0-89c5-973d4e1418e1 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:38.057804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:38.058383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:38.058673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:38.058954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:38.059662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:38.059987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:38.061561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:38.070283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 105/210] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:38.075248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:38.085301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f7039-66d8-418c-b5b9-6642005209ad admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:38.089232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06097b-8496-451a-8310-561625e04954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:38.089997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06097b-8496-451a-8310-561625e04954 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:38.090288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06097b-8496-451a-8310-561625e04954 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:38.090581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06097b-8496-451a-8310-561625e04954 admin admin] PATH_INFO: `/v3/users/6c6d4d4d250345d6aad47f0e2e83304e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:38.091655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06097b-8496-451a-8310-561625e04954 admin admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4d4d250345d6aad47f0e2e83304e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:38.093787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06097b-8496-451a-8310-561625e04954 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:38.095197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 106/211] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:38 2022] GET /identity/v3/users/6c6d4d4d250345d6aad47f0e2e83304e => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:38.099997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:38.108787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4d92-aa1f-42d7-a8cf-40af3e877101 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:38.112683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:38.113227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:38.113516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:38.113801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:38.121621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:38.123320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:38.132267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:38 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:38.137094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06097b-8496-451a-8310-561625e04954 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:38.145948 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06097b-8496-451a-8310-561625e04954 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:38.150027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d386a-a69b-4193-b893-1874d8619aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:38.150775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d386a-a69b-4193-b893-1874d8619aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:38.151065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d386a-a69b-4193-b893-1874d8619aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:38.151352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d386a-a69b-4193-b893-1874d8619aa7 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:38.152440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d386a-a69b-4193-b893-1874d8619aa7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:38.154419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d386a-a69b-4193-b893-1874d8619aa7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:38.155874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 107/213] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:38 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:38.160821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:38.169567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e9580-f8a0-41a5-a520-9d0b3a0acc38 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:38.173591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a013f3-7eb3-44e4-82cd-5ba3164c2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:38.174153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a013f3-7eb3-44e4-82cd-5ba3164c2631 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:38.174451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a013f3-7eb3-44e4-82cd-5ba3164c2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:38.174747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a013f3-7eb3-44e4-82cd-5ba3164c2631 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:38.175518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a013f3-7eb3-44e4-82cd-5ba3164c2631 admin admin] RBAC: Adding query filter params (role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2, user.id=6c6d4d4d250345d6aad47f0e2e83304e) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:38.175829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a013f3-7eb3-44e4-82cd-5ba3164c2631 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:38.177653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a013f3-7eb3-44e4-82cd-5ba3164c2631 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:38.183950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 107/214] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:38 2022] GET /identity/v3/role_assignments?user.id=6c6d4d4d250345d6aad47f0e2e83304e&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=5469eafdf12343518fe61660749f0e85 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:40.250913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0ae0-50ba-45a3-b888-2abd1fa6a8d0 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:40.251429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0ae0-50ba-45a3-b888-2abd1fa6a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:40.251540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c0ae0-50ba-45a3-b888-2abd1fa6a8d0 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:40.253195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 108/215] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:40.258792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526fc6-0031-488e-88d1-a2148b7b29cd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:40.259175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526fc6-0031-488e-88d1-a2148b7b29cd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:40.259371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20526fc6-0031-488e-88d1-a2148b7b29cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:40.281637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-20526fc6-0031-488e-88d1-a2148b7b29cd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:40.282766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-20526fc6-0031-488e-88d1-a2148b7b29cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:40.289672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 108/216] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:40 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:40.313615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0ae0-50ba-45a3-b888-2abd1fa6a8d0 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:40.326713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c0ae0-50ba-45a3-b888-2abd1fa6a8d0 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:40.330586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:40.331315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:40.331602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:40.331884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:40.343892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:40.351135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:40.352229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 109/217] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:40.357536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20526fc6-0031-488e-88d1-a2148b7b29cd None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:40.366469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20526fc6-0031-488e-88d1-a2148b7b29cd None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:40.370535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:40.371119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:40.371409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:40.371694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:40.372450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:40.372754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:40.374377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:40.383397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 109/218] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:40.388366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:40.398689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614c216-8e8a-4c6c-90d6-820da571b1f6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:40.402633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:40.403396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:40.403683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:40.403990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] PATH_INFO: `/v3/users/6c6d4d4d250345d6aad47f0e2e83304e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:40.405072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4d4d250345d6aad47f0e2e83304e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:40.407157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:40.408599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 110/219] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:40 2022] GET /identity/v3/users/6c6d4d4d250345d6aad47f0e2e83304e => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:40.414132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:40.422958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6db8b-c484-430a-ae4d-5e3dad7f08ac admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:40.426864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bd6d5-aa8c-496a-ba91-bd12acf55d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:40.427624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bd6d5-aa8c-496a-ba91-bd12acf55d2b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:40.428638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bd6d5-aa8c-496a-ba91-bd12acf55d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:40.428926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bd6d5-aa8c-496a-ba91-bd12acf55d2b admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:40.430010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bd6d5-aa8c-496a-ba91-bd12acf55d2b admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:40.432026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bd6d5-aa8c-496a-ba91-bd12acf55d2b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:40.433487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 110/220] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:40 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:40.438376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:40.447989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6d05-5cb2-438e-9c4d-a7523338b894 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:40.451899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff12a32-a4cf-41eb-a58e-a7540fff299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:40.452705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12a32-a4cf-41eb-a58e-a7540fff299d admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:40.452994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12a32-a4cf-41eb-a58e-a7540fff299d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:40.453276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff12a32-a4cf-41eb-a58e-a7540fff299d admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/users/6c6d4d4d250345d6aad47f0e2e83304e/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:40.455213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff12a32-a4cf-41eb-a58e-a7540fff299d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f49eab4461490fb0e5fea5d6ca05b2, user_id=6c6d4d4d250345d6aad47f0e2e83304e, role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:40.457797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff12a32-a4cf-41eb-a58e-a7540fff299d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:40.470372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 111/221] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:26:40 2022] PUT /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/users/6c6d4d4d250345d6aad47f0e2e83304e/roles/5469eafdf12343518fe61660749f0e85 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:26:42.536581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1d0ff-037b-443e-891b-276738a4ee69 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.537086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1d0ff-037b-443e-891b-276738a4ee69 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.537190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1d0ff-037b-443e-891b-276738a4ee69 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.539344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 111/222] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:42.544581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee379-4e51-4676-b2f1-d0ed5ae4e7f6 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.544980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee379-4e51-4676-b2f1-d0ed5ae4e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.545150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee379-4e51-4676-b2f1-d0ed5ae4e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.567486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bcbee379-4e51-4676-b2f1-d0ed5ae4e7f6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:42.570420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bcbee379-4e51-4676-b2f1-d0ed5ae4e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:42.632646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 112/223] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:42.656027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1d0ff-037b-443e-891b-276738a4ee69 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:42.668022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1d0ff-037b-443e-891b-276738a4ee69 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:42.671904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:42.672650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.672942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.673225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.684947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:42.691679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:42.692766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 112/224] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:42.698970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee379-4e51-4676-b2f1-d0ed5ae4e7f6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:42.707389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee379-4e51-4676-b2f1-d0ed5ae4e7f6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:42.712081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:42.712670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.712962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.713249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.713966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:42.714269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:42.715848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:42.724047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 113/225] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:42.728980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:42.737906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4e3c2-a6b3-4875-9a09-8e3cf010c8c3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:42.742849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:42.743557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.743844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.744159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] PATH_INFO: `/v3/users/6c6d4d4d250345d6aad47f0e2e83304e` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.745248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4d4d250345d6aad47f0e2e83304e)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:42.747451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:42.749010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 113/226] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:26:42 2022] GET /identity/v3/users/6c6d4d4d250345d6aad47f0e2e83304e => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:42.754206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:42.764043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a700aa-f465-4bd5-8278-daaf0a912075 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:42.768098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:42.768667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.768958 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.769242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.776970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:42.778691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:42.786931 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 114/227] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:42 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:42.792427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:42.801387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeee85-e6ee-4373-94bd-304270db373f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:42.806554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83a5dc-35fc-4ed6-a1e8-480ef764328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:42.807312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a5dc-35fc-4ed6-a1e8-480ef764328d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.807601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a5dc-35fc-4ed6-a1e8-480ef764328d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.807884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83a5dc-35fc-4ed6-a1e8-480ef764328d admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.808990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83a5dc-35fc-4ed6-a1e8-480ef764328d admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:42.810993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83a5dc-35fc-4ed6-a1e8-480ef764328d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:42.812481 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 114/228] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:42 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:42.817760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:42.826619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbbc4c-0b45-45fd-84ea-e26fd1ccfe71 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:42.830639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003140a-447b-44e3-ab24-6a007287a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:42.831194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003140a-447b-44e3-ab24-6a007287a602 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:42.831484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003140a-447b-44e3-ab24-6a007287a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:42.831769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003140a-447b-44e3-ab24-6a007287a602 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:42.832573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003140a-447b-44e3-ab24-6a007287a602 admin admin] RBAC: Adding query filter params (role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2, user.id=6c6d4d4d250345d6aad47f0e2e83304e) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:42.832880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003140a-447b-44e3-ab24-6a007287a602 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:42.834698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003140a-447b-44e3-ab24-6a007287a602 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:42.840270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 115/229] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:26:42 2022] GET /identity/v3/role_assignments?user.id=6c6d4d4d250345d6aad47f0e2e83304e&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=5469eafdf12343518fe61660749f0e85 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:44.953671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b9a9-5944-49ad-8481-b092e00a71e9 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:44.954243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b9a9-5944-49ad-8481-b092e00a71e9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:44.954243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b9a9-5944-49ad-8481-b092e00a71e9 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:44.955895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 115/230] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:44.961586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3689-ea99-4359-adfc-f9a7051985f2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:44.961997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3689-ea99-4359-adfc-f9a7051985f2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:44.962163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3689-ea99-4359-adfc-f9a7051985f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:44.983724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-780d3689-ea99-4359-adfc-f9a7051985f2 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:44.984894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-780d3689-ea99-4359-adfc-f9a7051985f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:44.992093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 116/231] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:45.014998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b9a9-5944-49ad-8481-b092e00a71e9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:45.026845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b9a9-5944-49ad-8481-b092e00a71e9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:45.030730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94079474-2c16-404d-ac10-9a990d5818e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:45.031429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94079474-2c16-404d-ac10-9a990d5818e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:45.031718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94079474-2c16-404d-ac10-9a990d5818e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:45.032030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94079474-2c16-404d-ac10-9a990d5818e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:45.033086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94079474-2c16-404d-ac10-9a990d5818e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:45.034755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94079474-2c16-404d-ac10-9a990d5818e1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:45.036203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 116/232] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:45.041162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3689-ea99-4359-adfc-f9a7051985f2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:45.049470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3689-ea99-4359-adfc-f9a7051985f2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:45.054246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca703d-99b8-41a1-93dd-28af53753595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:45.054851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca703d-99b8-41a1-93dd-28af53753595 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:45.055141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca703d-99b8-41a1-93dd-28af53753595 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:45.055427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca703d-99b8-41a1-93dd-28af53753595 admin admin] PATH_INFO: `/v3/groups` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:45.056101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca703d-99b8-41a1-93dd-28af53753595 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:45.057095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-57ca703d-99b8-41a1-93dd-28af53753595 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:26:45.057095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:26:45.057095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:26:45.058273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca703d-99b8-41a1-93dd-28af53753595 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:45.071315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 117/233] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Apr 8 02:26:45 2022] POST /identity/v3/groups => generated 229 bytes in 30 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:26:47.195481 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c4b4-afec-4630-9191-b08438b3d4e2 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:47.196049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c4b4-afec-4630-9191-b08438b3d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:47.196158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78c4b4-afec-4630-9191-b08438b3d4e2 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:47.197743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 117/234] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:47.202982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a89f6-49ef-46c6-be6d-fd236629f62f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:47.203357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a89f6-49ef-46c6-be6d-fd236629f62f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:47.203564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a89f6-49ef-46c6-be6d-fd236629f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:47.226383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-331a89f6-49ef-46c6-be6d-fd236629f62f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:47.227521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-331a89f6-49ef-46c6-be6d-fd236629f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:47.234392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 118/235] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:47.256597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78c4b4-afec-4630-9191-b08438b3d4e2 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:47.268154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78c4b4-afec-4630-9191-b08438b3d4e2 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:47.272618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3326d4c-a32d-4940-b013-6a2897a9fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:47.273319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326d4c-a32d-4940-b013-6a2897a9fb44 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:47.273613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326d4c-a32d-4940-b013-6a2897a9fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:47.273900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3326d4c-a32d-4940-b013-6a2897a9fb44 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:47.274981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3326d4c-a32d-4940-b013-6a2897a9fb44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:47.276716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3326d4c-a32d-4940-b013-6a2897a9fb44 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:47.278142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 118/236] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:47.283141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a89f6-49ef-46c6-be6d-fd236629f62f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:47.292188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a89f6-49ef-46c6-be6d-fd236629f62f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:47.296166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d2002-6fba-4adc-ac6f-8a1747bc5f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:47.296837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2002-6fba-4adc-ac6f-8a1747bc5f0b admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:47.297134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2002-6fba-4adc-ac6f-8a1747bc5f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:47.297422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d2002-6fba-4adc-ac6f-8a1747bc5f0b admin admin] PATH_INFO: `/v3/groups` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:47.298061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d2002-6fba-4adc-ac6f-8a1747bc5f0b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:47.299962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d2002-6fba-4adc-ac6f-8a1747bc5f0b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:47.313214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 119/237] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Apr 8 02:26:47 2022] POST /identity/v3/groups => generated 226 bytes in 30 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:26:49.546827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ebb85-fc29-467f-85a8-b6768d234018 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.547375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ebb85-fc29-467f-85a8-b6768d234018 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.547375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ebb85-fc29-467f-85a8-b6768d234018 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.549072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 119/238] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:49.554848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6da03a-0b55-4e83-bb3c-6c2912c81524 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.555258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6da03a-0b55-4e83-bb3c-6c2912c81524 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.555415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6da03a-0b55-4e83-bb3c-6c2912c81524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.578242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6c6da03a-0b55-4e83-bb3c-6c2912c81524 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:49.579373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6c6da03a-0b55-4e83-bb3c-6c2912c81524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:49.586976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 120/239] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:49 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:49.609599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ebb85-fc29-467f-85a8-b6768d234018 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.621526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ebb85-fc29-467f-85a8-b6768d234018 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.625466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.626167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.626453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.626733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.638444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:49.644759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:49.645818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 120/240] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:49.651318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6da03a-0b55-4e83-bb3c-6c2912c81524 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.659718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6da03a-0b55-4e83-bb3c-6c2912c81524 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.663716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.664343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.664632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.664914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.665626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:49.665924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:49.667507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:49.675762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 121/241] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:49.683078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.692183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd425415-7568-4c61-a359-09531610ea2d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.696792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.697359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.697649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.697933 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.705376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:49.707106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:49.715303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 121/242] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:49.720445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.729575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7281c-bfd7-4128-ad23-b7560485014e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.733592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.734314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.734604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.734886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.735987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:49.737999 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:49.739478 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 122/243] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:49.744777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.752864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600eabc-eb82-49bd-900b-af1e3904fd59 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.757473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeb0b7-ad5c-4d00-b9b7-42f075a24338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.758225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeb0b7-ad5c-4d00-b9b7-42f075a24338 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.758514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeb0b7-ad5c-4d00-b9b7-42f075a24338 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.758798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeb0b7-ad5c-4d00-b9b7-42f075a24338 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.763485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaeb0b7-ad5c-4d00-b9b7-42f075a24338 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:49.764487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-cbaeb0b7-ad5c-4d00-b9b7-42f075a24338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:26:49.764487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:26:49.764487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:26:49.765634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaeb0b7-ad5c-4d00-b9b7-42f075a24338 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:49.767022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 122/244] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:49.772166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:49.781012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549b208-d211-45e2-80d4-63115bd06437 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:49.784919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b98a6-000e-4bbf-aa3f-67b27e5a82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:49.785475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b98a6-000e-4bbf-aa3f-67b27e5a82e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:49.785765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b98a6-000e-4bbf-aa3f-67b27e5a82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:49.786054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b98a6-000e-4bbf-aa3f-67b27e5a82e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:49.786816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b98a6-000e-4bbf-aa3f-67b27e5a82e0 admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:49.787141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b98a6-000e-4bbf-aa3f-67b27e5a82e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:49.788948 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b98a6-000e-4bbf-aa3f-67b27e5a82e0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:49.794167 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 123/245] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:26:49 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=042411de09cb47e0a875e39fd1ace847 => generated 260 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:51.850918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057ec65-e12a-4b65-bb1d-c1568476d1e4 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.851458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057ec65-e12a-4b65-bb1d-c1568476d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.851545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057ec65-e12a-4b65-bb1d-c1568476d1e4 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.853206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 123/246] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:51.858196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0806c-641a-4a69-81bb-bc4d82582a37 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.858555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0806c-641a-4a69-81bb-bc4d82582a37 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.858771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0806c-641a-4a69-81bb-bc4d82582a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.881768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-96d0806c-641a-4a69-81bb-bc4d82582a37 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:51.882796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-96d0806c-641a-4a69-81bb-bc4d82582a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:51.889497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 124/247] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:51.911013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057ec65-e12a-4b65-bb1d-c1568476d1e4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.922744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057ec65-e12a-4b65-bb1d-c1568476d1e4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.926706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:51.927416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.928253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.928540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.939392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:51.946423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:51.947488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 124/248] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:51.952831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0806c-641a-4a69-81bb-bc4d82582a37 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.962911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0806c-641a-4a69-81bb-bc4d82582a37 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.966963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:51.967555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:51.967848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:51.968169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:51.968888 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:51.969194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:51.970784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:51.979160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 125/249] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:51.984337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:51.995749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dada6f-1a59-438d-b13a-214653261d42 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:51.999780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:52.000567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:52.000859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:52.001145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:52.002208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:52.004136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:52.005559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 125/250] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:26:51 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:52.011433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:52.020457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838c4ac-4fab-464a-ac0e-01ced4d09369 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:52.024459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6c3f-3754-4272-9d13-585f26d38fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:52.025224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6c3f-3754-4272-9d13-585f26d38fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:52.025515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6c3f-3754-4272-9d13-585f26d38fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:52.025802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6c3f-3754-4272-9d13-585f26d38fd4 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:52.026881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6c3f-3754-4272-9d13-585f26d38fd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:52.028920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6c3f-3754-4272-9d13-585f26d38fd4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:52.030394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 126/251] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:52 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:52.035397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:52.044276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42707694-0fec-495a-b05d-7fe3d74410a6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:52.048206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123a3c-720d-4e97-ae3e-c683c57ec925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:52.048969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123a3c-720d-4e97-ae3e-c683c57ec925 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:52.049260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123a3c-720d-4e97-ae3e-c683c57ec925 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:52.049544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123a3c-720d-4e97-ae3e-c683c57ec925 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/groups/9f3cc080129945f0843e3dba25c25cab/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:52.051271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123a3c-720d-4e97-ae3e-c683c57ec925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa633b97da43ea83a6bfe98cf63dd1, group_id=9f3cc080129945f0843e3dba25c25cab, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:52.054385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123a3c-720d-4e97-ae3e-c683c57ec925 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:52.066214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 126/252] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Apr 8 02:26:52 2022] PUT /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/groups/9f3cc080129945f0843e3dba25c25cab/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:26:54.133371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba4a1-a2df-4cad-95c0-215f9575258d None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.133924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba4a1-a2df-4cad-95c0-215f9575258d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.133924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ba4a1-a2df-4cad-95c0-215f9575258d None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.135637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 127/253] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:54.140914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11987ad-1ae6-4dcf-9219-c4c03d8c8844 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.141328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11987ad-1ae6-4dcf-9219-c4c03d8c8844 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.141491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11987ad-1ae6-4dcf-9219-c4c03d8c8844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.164331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b11987ad-1ae6-4dcf-9219-c4c03d8c8844 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:54.165471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b11987ad-1ae6-4dcf-9219-c4c03d8c8844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:54.232707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 127/254] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:54 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:54.255011 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba4a1-a2df-4cad-95c0-215f9575258d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.266674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ba4a1-a2df-4cad-95c0-215f9575258d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.270815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.272035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.272325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.272607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.283720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:54.290806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:26:54.291870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 128/255] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:54.297351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11987ad-1ae6-4dcf-9219-c4c03d8c8844 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.306175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11987ad-1ae6-4dcf-9219-c4c03d8c8844 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.310217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.310805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.311102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.311390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.312140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] RBAC: Adding query filter params (name=member) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:54.312445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.314028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:54.322498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 128/256] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:54.327552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.337149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f3ad9-c4a8-4f83-81f2-b5412e0900b6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.341159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.341712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.342001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.342285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.349919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.351643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:54.359836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 129/257] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:54.364809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.375952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c74bc9-4cc5-4877-ab4c-f9c61bc8cfff admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.379899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.381283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.381775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.381903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.382985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.385077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:54.386529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 129/258] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:54.391914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.401064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec94d-4589-4977-a4d3-3f6979a47aeb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.405122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246ccb-c2c2-4bf7-8566-99b8b7923dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.405887 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ccb-c2c2-4bf7-8566-99b8b7923dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.406175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ccb-c2c2-4bf7-8566-99b8b7923dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.406453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ccb-c2c2-4bf7-8566-99b8b7923dd3 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.407515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0246ccb-c2c2-4bf7-8566-99b8b7923dd3 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.408528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-c0246ccb-c2c2-4bf7-8566-99b8b7923dd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:26:54.408528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:26:54.408528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:26:54.409692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0246ccb-c2c2-4bf7-8566-99b8b7923dd3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:54.411114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 130/259] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:54.416367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:54.425436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d434d6-7976-46ae-9b00-d094a0807d49 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:54.429643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a361b63-3b88-4b34-a43d-5d8c0a562b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:54.430192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a361b63-3b88-4b34-a43d-5d8c0a562b3b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:54.430486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a361b63-3b88-4b34-a43d-5d8c0a562b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:54.430769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a361b63-3b88-4b34-a43d-5d8c0a562b3b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:54.431527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a361b63-3b88-4b34-a43d-5d8c0a562b3b admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:54.431832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a361b63-3b88-4b34-a43d-5d8c0a562b3b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:54.433638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a361b63-3b88-4b34-a43d-5d8c0a562b3b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:54.439871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 130/260] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:26:54 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=042411de09cb47e0a875e39fd1ace847 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:56.621678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1adbc-c76e-41f7-84f0-5c187f1def57 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.622209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1adbc-c76e-41f7-84f0-5c187f1def57 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.622304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1adbc-c76e-41f7-84f0-5c187f1def57 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.623904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 131/261] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:56.629135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c1e7-a78e-43e9-9e17-6af3e84e5e32 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.629545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c1e7-a78e-43e9-9e17-6af3e84e5e32 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.629719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0c1e7-a78e-43e9-9e17-6af3e84e5e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.652504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a5d0c1e7-a78e-43e9-9e17-6af3e84e5e32 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:56.653653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a5d0c1e7-a78e-43e9-9e17-6af3e84e5e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:56.660427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 131/262] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:26:56.682984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1adbc-c76e-41f7-84f0-5c187f1def57 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.695186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1adbc-c76e-41f7-84f0-5c187f1def57 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.699079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.699801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.700117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.700403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.711750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:56.718522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:56.719578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 132/263] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:56.725076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c1e7-a78e-43e9-9e17-6af3e84e5e32 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.733516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0c1e7-a78e-43e9-9e17-6af3e84e5e32 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.737479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.738057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.738350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.738635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.739343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:56.739646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.741492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:56.749599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 132/264] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:56.754607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.764692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb36b3b-3d8b-46e7-9d5a-4817d9ca91ba admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.768686 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.769237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.769526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.769810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.778179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.779898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:56.788480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 133/265] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:26:56.793836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.803586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b8c6d-12da-45fd-94f1-c96a208f1554 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.807516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.808316 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.808607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.808891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.809964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.811994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:56.813468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 133/266] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:26:56.818794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.827046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06a07d-73a8-4cbc-8eea-962f45e0dd3a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.830987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c25883-e360-4c6b-bde8-3c4de884ee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.831746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25883-e360-4c6b-bde8-3c4de884ee84 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.832065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25883-e360-4c6b-bde8-3c4de884ee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.832347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c25883-e360-4c6b-bde8-3c4de884ee84 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.833416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c25883-e360-4c6b-bde8-3c4de884ee84 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.835883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c25883-e360-4c6b-bde8-3c4de884ee84 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:56.837312 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 134/267] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:56.842524 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:56.851401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad494dc-fb77-4f5f-bf51-45ba540b21c6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:56.855273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9319-08b4-42a9-903b-292227f23c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:56.855821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9319-08b4-42a9-903b-292227f23c32 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:56.856130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9319-08b4-42a9-903b-292227f23c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:56.856416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9319-08b4-42a9-903b-292227f23c32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:56.857175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9319-08b4-42a9-903b-292227f23c32 admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:56.857478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9319-08b4-42a9-903b-292227f23c32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:56.859246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9319-08b4-42a9-903b-292227f23c32 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:56.864377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 134/268] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:26:56 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=5469eafdf12343518fe61660749f0e85 => generated 260 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:59.001746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c6ca-2ecc-4093-82b6-3c856fd37deb None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:59.002326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c6ca-2ecc-4093-82b6-3c856fd37deb None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:59.002326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4c6ca-2ecc-4093-82b6-3c856fd37deb None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:59.003983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 135/269] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:26:59.009789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304ac6-e429-44bf-a50a-3eb658b9effd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:59.010228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304ac6-e429-44bf-a50a-3eb658b9effd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:59.010363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304ac6-e429-44bf-a50a-3eb658b9effd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:59.032326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6b304ac6-e429-44bf-a50a-3eb658b9effd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:26:59.033448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6b304ac6-e429-44bf-a50a-3eb658b9effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:26:59.040180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 135/270] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:26:59 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:26:59.062413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c6ca-2ecc-4093-82b6-3c856fd37deb None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:59.074771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4c6ca-2ecc-4093-82b6-3c856fd37deb None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:59.078620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:59.079336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:59.079622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:59.079904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:59.091850 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:26:59.098544 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:26:59.100149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 136/271] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:26:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:26:59.105400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304ac6-e429-44bf-a50a-3eb658b9effd None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:59.113794 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304ac6-e429-44bf-a50a-3eb658b9effd None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:59.117852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:59.118440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:59.118731 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:59.119019 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:59.119730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:26:59.120086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:59.121658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:59.129779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 136/272] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:26:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:59.135626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:59.144971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f71df-0a3b-4307-af28-97992ee5348a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:59.149981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:59.150719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:59.151004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:59.151284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:59.152493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:59.154348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:59.155752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 137/273] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:26:59 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:59.160693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:59.169555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517369dc-474b-4e54-a840-9afa218808c9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:59.173507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c6a81-3a9e-4547-9430-d266ae78d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:59.174269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c6a81-3a9e-4547-9430-d266ae78d4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:59.174561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c6a81-3a9e-4547-9430-d266ae78d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:59.174845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c6a81-3a9e-4547-9430-d266ae78d4e5 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:59.175915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c6a81-3a9e-4547-9430-d266ae78d4e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:59.178313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c6a81-3a9e-4547-9430-d266ae78d4e5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:59.179775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 137/274] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:26:59 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:26:59.184794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:26:59.194325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246060-cb99-4487-a9ae-4509b50ee67e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:26:59.198316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa291-1b85-436c-bb18-9148d827adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:26:59.199088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa291-1b85-436c-bb18-9148d827adf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:26:59.199378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa291-1b85-436c-bb18-9148d827adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:26:59.199667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa291-1b85-436c-bb18-9148d827adf7 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/groups/9f3cc080129945f0843e3dba25c25cab/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:26:59.201674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa291-1b85-436c-bb18-9148d827adf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0fa633b97da43ea83a6bfe98cf63dd1, group_id=9f3cc080129945f0843e3dba25c25cab, role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:26:59.204278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa291-1b85-436c-bb18-9148d827adf7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:26:59.216489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 138/275] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Apr 8 02:26:59 2022] PUT /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1/groups/9f3cc080129945f0843e3dba25c25cab/roles/5469eafdf12343518fe61660749f0e85 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:27:01.339157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b08d-5fbf-4d33-9761-5ab82420a315 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.339704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b08d-5fbf-4d33-9761-5ab82420a315 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.339704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b08d-5fbf-4d33-9761-5ab82420a315 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.341419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 138/276] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:01.346554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccab6b-47f4-45b1-b29c-f5cb25a5a2b4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.346951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccab6b-47f4-45b1-b29c-f5cb25a5a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.347132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccab6b-47f4-45b1-b29c-f5cb25a5a2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.370491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a5ccab6b-47f4-45b1-b29c-f5cb25a5a2b4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:01.371631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a5ccab6b-47f4-45b1-b29c-f5cb25a5a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:01.433721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 139/277] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:01 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:01.456904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b08d-5fbf-4d33-9761-5ab82420a315 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.469238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b08d-5fbf-4d33-9761-5ab82420a315 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.473194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.473921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.474354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.474649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.485875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:01.493190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:27:01.494267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 139/278] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:27:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:01.500179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccab6b-47f4-45b1-b29c-f5cb25a5a2b4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.509323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccab6b-47f4-45b1-b29c-f5cb25a5a2b4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.513340 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.513929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.514222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.514507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.515224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:01.515525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.517149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:01.525300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 140/279] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:01.530373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.539495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c3d58-ef73-4716-a584-66ceca975050 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.543459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.544052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.544346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.544633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.553017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.554860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:01.563109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 140/280] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:01 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:01.568810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.577872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe8209-9711-493d-9d84-e48bc574b7a4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.581835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.582598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.582886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.583168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.584333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.586331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:01.587795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 141/281] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:01 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:01.592830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.600913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfbc39-b980-4415-b10d-3c4b60a9ba8e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.604877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99f0d1-9e2c-4f01-8d13-743ee23627f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.605627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f0d1-9e2c-4f01-8d13-743ee23627f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.605923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f0d1-9e2c-4f01-8d13-743ee23627f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.606210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99f0d1-9e2c-4f01-8d13-743ee23627f8 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.607268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99f0d1-9e2c-4f01-8d13-743ee23627f8 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.609135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99f0d1-9e2c-4f01-8d13-743ee23627f8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:01.610529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 141/282] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:01 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:01.616123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:01.624921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a9c4e-3928-493e-9d5c-476a267ac3a1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:01.628872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1ae8d-9c9c-4ec0-bc90-3a6fa80094e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:01.629418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1ae8d-9c9c-4ec0-bc90-3a6fa80094e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:01.629711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1ae8d-9c9c-4ec0-bc90-3a6fa80094e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:01.629998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1ae8d-9c9c-4ec0-bc90-3a6fa80094e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:01.630976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1ae8d-9c9c-4ec0-bc90-3a6fa80094e2 admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:01.631281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1ae8d-9c9c-4ec0-bc90-3a6fa80094e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:01.633074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1ae8d-9c9c-4ec0-bc90-3a6fa80094e2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:01.638572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 142/283] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:27:01 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1&role.id=5469eafdf12343518fe61660749f0e85 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:03.867326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ee84d-c6fd-441f-b537-bba5d0f19822 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:03.867879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ee84d-c6fd-441f-b537-bba5d0f19822 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:03.868017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ee84d-c6fd-441f-b537-bba5d0f19822 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:03.869645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 142/284] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:03.874734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ce65-c93d-425d-8ee1-8a0286ff9281 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:03.875168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ce65-c93d-425d-8ee1-8a0286ff9281 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:03.875306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20ce65-c93d-425d-8ee1-8a0286ff9281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:03.897737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-ef20ce65-c93d-425d-8ee1-8a0286ff9281 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:03.898901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ef20ce65-c93d-425d-8ee1-8a0286ff9281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:03.905678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 143/285] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:03.929383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ee84d-c6fd-441f-b537-bba5d0f19822 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:03.941043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ee84d-c6fd-441f-b537-bba5d0f19822 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:03.945833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:03.946539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:03.946830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:03.947117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:03.957986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:03.964468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:03.965545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 143/286] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:03.971024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20ce65-c93d-425d-8ee1-8a0286ff9281 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:03.979577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20ce65-c93d-425d-8ee1-8a0286ff9281 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:03.983632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:03.984258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:03.984548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:03.984832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:03.985547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:03.985853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:03.987436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:03.996417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 144/287] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:04.001378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:04.011786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1ae42-7ab3-46cc-a464-34310cb98066 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:04.015796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:04.016384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:04.016677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:04.016963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:04.024572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:04.026302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:04.034546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 144/288] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:04 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:04.039542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:04.048422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff9674-b12c-4592-b7f5-8691340cc90d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:04.053130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:04.053919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:04.054210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:04.054492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:04.055572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:04.057595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:04.059062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 145/289] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:04 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:04.063847 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:04.072712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36d8e-f2b7-4010-92f4-69e5b3e7c0f7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:04.076711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e01db-5b1f-413a-b6a6-749ee5b514a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:04.077464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e01db-5b1f-413a-b6a6-749ee5b514a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:04.077757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e01db-5b1f-413a-b6a6-749ee5b514a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:04.078049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e01db-5b1f-413a-b6a6-749ee5b514a0 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:04.079104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e01db-5b1f-413a-b6a6-749ee5b514a0 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:04.080987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e01db-5b1f-413a-b6a6-749ee5b514a0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:04.082399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 145/290] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:04 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:04.087944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:04.096723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e565dd0-5760-4f9b-a02b-8f6dd5ffed97 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:04.101175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b63ef-9e65-4bb4-9f98-58e5a0379c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:04.101720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b63ef-9e65-4bb4-9f98-58e5a0379c6e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:04.102010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b63ef-9e65-4bb4-9f98-58e5a0379c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:04.102295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b63ef-9e65-4bb4-9f98-58e5a0379c6e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:04.103055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b63ef-9e65-4bb4-9f98-58e5a0379c6e admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:04.103363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b63ef-9e65-4bb4-9f98-58e5a0379c6e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:04.105152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b63ef-9e65-4bb4-9f98-58e5a0379c6e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:04.110248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 146/291] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:27:04 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=042411de09cb47e0a875e39fd1ace847 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:06.163063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bf93-7443-4348-95ef-c1b704c95b27 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:06.163691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bf93-7443-4348-95ef-c1b704c95b27 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:06.163691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5bf93-7443-4348-95ef-c1b704c95b27 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:06.165333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 146/292] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:06.170475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b427-ff82-4e52-8f03-b2908845bd6e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:06.170867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b427-ff82-4e52-8f03-b2908845bd6e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:06.171041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9b427-ff82-4e52-8f03-b2908845bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:06.194541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-0ac9b427-ff82-4e52-8f03-b2908845bd6e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:06.195670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0ac9b427-ff82-4e52-8f03-b2908845bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:06.202317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 147/293] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:06.224392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bf93-7443-4348-95ef-c1b704c95b27 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:06.235760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5bf93-7443-4348-95ef-c1b704c95b27 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:06.240327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:06.241213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:06.241549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:06.241885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:06.252731 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:06.259845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:06.260923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 147/294] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:27:06.266191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9b427-ff82-4e52-8f03-b2908845bd6e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:06.274668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9b427-ff82-4e52-8f03-b2908845bd6e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:06.278608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:06.279189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:06.279474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:06.279753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:06.280493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:06.280792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:06.282368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:06.290601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 148/295] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:06.295650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:06.305891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf4900-93de-4e8b-b43b-74067a9f9858 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:06.309939 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:06.310692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:06.310981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:06.311265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:06.312377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:06.314261 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:06.315666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 148/296] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:06 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:06.321279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:06.330156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf6e4-e930-4902-b8e2-c2ea9fa64db6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:06.334539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0528e-9632-4240-835a-cf380f2ac4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:06.335289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0528e-9632-4240-835a-cf380f2ac4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:06.335576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0528e-9632-4240-835a-cf380f2ac4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:06.335855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0528e-9632-4240-835a-cf380f2ac4c1 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:06.336946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0528e-9632-4240-835a-cf380f2ac4c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:06.338921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0528e-9632-4240-835a-cf380f2ac4c1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:06.340420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 149/297] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:06 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:06.345249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:06.354586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffc56a-3f17-47d9-a6e9-efe39469ce75 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:06.358628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3bc7d-6306-40b2-89ea-bc7ee1336bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:06.359401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3bc7d-6306-40b2-89ea-bc7ee1336bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:06.359694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3bc7d-6306-40b2-89ea-bc7ee1336bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:06.360016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3bc7d-6306-40b2-89ea-bc7ee1336bd2 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/groups/9f3cc080129945f0843e3dba25c25cab/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:06.361745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3bc7d-6306-40b2-89ea-bc7ee1336bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f49eab4461490fb0e5fea5d6ca05b2, group_id=9f3cc080129945f0843e3dba25c25cab, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:06.364389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3bc7d-6306-40b2-89ea-bc7ee1336bd2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:06.377395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 149/298] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Apr 8 02:27:06 2022] PUT /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/groups/9f3cc080129945f0843e3dba25c25cab/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:27:08.458186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c24b8-44fb-4679-95cf-cb291dc53789 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.458975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c24b8-44fb-4679-95cf-cb291dc53789 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.459272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c24b8-44fb-4679-95cf-cb291dc53789 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.460997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 150/299] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:08.466294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64adf-9891-472f-9c15-c95a7febb244 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.466707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64adf-9891-472f-9c15-c95a7febb244 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.466964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64adf-9891-472f-9c15-c95a7febb244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.488572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b3f64adf-9891-472f-9c15-c95a7febb244 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:08.490331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b3f64adf-9891-472f-9c15-c95a7febb244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:08.551673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 150/300] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:08.576078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c24b8-44fb-4679-95cf-cb291dc53789 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:08.587892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c24b8-44fb-4679-95cf-cb291dc53789 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:08.591796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:08.592584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.592879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.593169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.604976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:08.611401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 08 02:27:08.612503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 151/301] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:08.618555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f64adf-9891-472f-9c15-c95a7febb244 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:08.626935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f64adf-9891-472f-9c15-c95a7febb244 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:08.630930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:08.631515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.631807 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.632120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.633018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] RBAC: Adding query filter params (name=member) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:08.633325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:08.634904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:08.643193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 151/302] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:27:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:08.648463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:08.657534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c36c7-ea19-4a0d-bdbd-b411ac9ead9c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:08.662027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:08.662583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.662877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.663164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.670707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:08.672490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:08.681664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 152/303] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:08.686889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:08.695913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e500e-eeed-40eb-bc7f-14d1de4e281c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:08.699841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:08.700640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.700932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.701219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.702293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:08.704351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:08.705829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 152/304] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:08 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:08.710800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:08.718922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579b4d9-7cad-434e-8daa-a5c9ebe73f29 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:08.722896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4752a-ea92-4261-bc49-344474071928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:08.723656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4752a-ea92-4261-bc49-344474071928 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.724564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4752a-ea92-4261-bc49-344474071928 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.724856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4752a-ea92-4261-bc49-344474071928 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.725927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4752a-ea92-4261-bc49-344474071928 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:08.727782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4752a-ea92-4261-bc49-344474071928 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:08.729226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 153/305] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:08 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:08.734238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:08.743085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3eb45-cf8a-41cb-8ec2-e472e8069458 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:08.747002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c074-eba1-4340-8ac2-8943bef4d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:08.747549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c074-eba1-4340-8ac2-8943bef4d511 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:08.747841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c074-eba1-4340-8ac2-8943bef4d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:08.748151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c074-eba1-4340-8ac2-8943bef4d511 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:08.748914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c074-eba1-4340-8ac2-8943bef4d511 admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=042411de09cb47e0a875e39fd1ace847, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:08.749224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c074-eba1-4340-8ac2-8943bef4d511 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:08.750980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c074-eba1-4340-8ac2-8943bef4d511 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:08.757124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 153/306] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:27:08 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=042411de09cb47e0a875e39fd1ace847 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:10.931527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b266-13db-4c9f-86e1-ba6670d98101 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:10.932098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b266-13db-4c9f-86e1-ba6670d98101 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:10.932098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b266-13db-4c9f-86e1-ba6670d98101 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:10.933786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 154/307] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:10.938867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee744f-6f63-4d55-845a-1ab67f994998 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:10.939237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee744f-6f63-4d55-845a-1ab67f994998 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:10.939448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee744f-6f63-4d55-845a-1ab67f994998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:10.963427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4fee744f-6f63-4d55-845a-1ab67f994998 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:10.964609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4fee744f-6f63-4d55-845a-1ab67f994998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:10.971376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 154/308] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:10.993889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99b266-13db-4c9f-86e1-ba6670d98101 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.006465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99b266-13db-4c9f-86e1-ba6670d98101 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.010384 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.011107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.011393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.011674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.023734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:11.030386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:27:11.031469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 155/309] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:27:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:11.037265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee744f-6f63-4d55-845a-1ab67f994998 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.045738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee744f-6f63-4d55-845a-1ab67f994998 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.049751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.050339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.050633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.050917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.051629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:11.051951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:11.053780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:11.061817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 155/310] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:11.066878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.076936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e257-afe6-4495-ae34-544b6342c389 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.080905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.081458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.081747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.082031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.089734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:11.091461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:11.100668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 156/311] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:11 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:11.105711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.115130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ed6a2-bfd0-4508-83c6-53d4738f61e4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.119393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.120198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.120490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.120777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.121856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:11.123842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:11.125328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 156/312] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:11 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:11.130031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.138375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa9136-311f-4d4e-b167-4b4374fe839a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.142458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c42a7-e716-49bf-a826-a88b1236f412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.143208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c42a7-e716-49bf-a826-a88b1236f412 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.143495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c42a7-e716-49bf-a826-a88b1236f412 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.143783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c42a7-e716-49bf-a826-a88b1236f412 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.144880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c42a7-e716-49bf-a826-a88b1236f412 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:11.147010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c42a7-e716-49bf-a826-a88b1236f412 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:11.148459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 157/313] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:11 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:11.153579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:11.163409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842449a-7ec8-44e4-bde3-4d39b65d009b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:11.167347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a50df-f1c6-4043-a7cd-60e78db9b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:11.167892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a50df-f1c6-4043-a7cd-60e78db9b58b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:11.168205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a50df-f1c6-4043-a7cd-60e78db9b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:11.168488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a50df-f1c6-4043-a7cd-60e78db9b58b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:11.169249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a50df-f1c6-4043-a7cd-60e78db9b58b admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:11.169550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a50df-f1c6-4043-a7cd-60e78db9b58b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:11.171307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a50df-f1c6-4043-a7cd-60e78db9b58b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:11.176420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 157/314] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:27:11 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=5469eafdf12343518fe61660749f0e85 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:13.243507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ab2c-f94c-4ddf-96dd-ded596491544 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:13.244052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ab2c-f94c-4ddf-96dd-ded596491544 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:13.244141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ab2c-f94c-4ddf-96dd-ded596491544 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:13.245769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 158/315] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:13.250736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e158-a6e6-4dea-95e5-b2b9e9d5bdef None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:13.251129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e158-a6e6-4dea-95e5-b2b9e9d5bdef None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:13.251322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e158-a6e6-4dea-95e5-b2b9e9d5bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:13.273275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a219e158-a6e6-4dea-95e5-b2b9e9d5bdef None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:13.274406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a219e158-a6e6-4dea-95e5-b2b9e9d5bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:13.281176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 158/316] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:13.305091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ab2c-f94c-4ddf-96dd-ded596491544 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:13.316627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ab2c-f94c-4ddf-96dd-ded596491544 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:13.320611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:13.321332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:13.321620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:13.321900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:13.332827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:13.339752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:27:13.340837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 159/317] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:27:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:13.346153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e158-a6e6-4dea-95e5-b2b9e9d5bdef None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:13.355125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e158-a6e6-4dea-95e5-b2b9e9d5bdef None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:13.359162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:13.359747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:13.360150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:13.360443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:13.361156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:13.361459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:13.363078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:13.372022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 159/318] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:13.377091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:13.387831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaaba7-0d7e-4375-b36d-3de3f358faf8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:13.391880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:13.392665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:13.392957 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:13.393244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:13.394310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:13.396359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:13.397784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 160/319] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:13 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:13.402678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:13.412090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b88a8f-cf38-4c44-9805-641aae56e0db admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:13.416029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671374d2-8a09-4d70-92a6-431921a47d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:13.416791 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671374d2-8a09-4d70-92a6-431921a47d1d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:13.417083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671374d2-8a09-4d70-92a6-431921a47d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:13.417367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671374d2-8a09-4d70-92a6-431921a47d1d admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:13.418445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671374d2-8a09-4d70-92a6-431921a47d1d admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:13.420472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671374d2-8a09-4d70-92a6-431921a47d1d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:13.421943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 160/320] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:13 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:13.426857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:13.436662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf5005-8b42-4804-91b0-719a38fd4f87 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:13.440723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116139bb-bc97-4cda-b3ed-95d7a6ab1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:13.441497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116139bb-bc97-4cda-b3ed-95d7a6ab1139 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:13.441787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116139bb-bc97-4cda-b3ed-95d7a6ab1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:13.442071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116139bb-bc97-4cda-b3ed-95d7a6ab1139 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/groups/9f3cc080129945f0843e3dba25c25cab/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:13.444286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116139bb-bc97-4cda-b3ed-95d7a6ab1139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f49eab4461490fb0e5fea5d6ca05b2, group_id=9f3cc080129945f0843e3dba25c25cab, role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:13.446849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116139bb-bc97-4cda-b3ed-95d7a6ab1139 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:13.459477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 161/321] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Apr 8 02:27:13 2022] PUT /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2/groups/9f3cc080129945f0843e3dba25c25cab/roles/5469eafdf12343518fe61660749f0e85 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:27:15.566716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf933-5691-4814-a69d-4b138cee77eb None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.567218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf933-5691-4814-a69d-4b138cee77eb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.567299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daf933-5691-4814-a69d-4b138cee77eb None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.569486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 161/322] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:15.574559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366526a6-5d19-427b-a90f-a99a2f584a95 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.574992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366526a6-5d19-427b-a90f-a99a2f584a95 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.575119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366526a6-5d19-427b-a90f-a99a2f584a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.596471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-366526a6-5d19-427b-a90f-a99a2f584a95 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:15.597599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-366526a6-5d19-427b-a90f-a99a2f584a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:15.659297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 162/323] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:15.683266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daf933-5691-4814-a69d-4b138cee77eb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:15.694819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15daf933-5691-4814-a69d-4b138cee77eb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:15.698727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:15.699449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.699743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.700059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.711694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:15.718469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:27:15.719529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 162/324] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:27:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:15.725126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366526a6-5d19-427b-a90f-a99a2f584a95 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:15.733506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366526a6-5d19-427b-a90f-a99a2f584a95 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:15.737437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:15.738016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.738303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.738584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.739789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:15.740234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:15.741807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:15.749981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 163/325] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:15.755556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:15.764870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895b3b-4413-42b9-9898-09940c132b54 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:15.768907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:15.769467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.769762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.770049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.777736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:15.779485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:15.788513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 163/326] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:15.793562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:15.803370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e490c-65fd-44e7-a08f-fca45ebb3ab3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:15.807353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:15.808150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.808442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.808730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.809800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:15.811790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:15.813309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 164/327] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:15 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:15.818777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:15.826922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10525d22-8f1f-4ce0-ae06-11817ed44a01 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:15.830881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd40c5-9a38-4cf9-8f60-2d144aade177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:15.831641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd40c5-9a38-4cf9-8f60-2d144aade177 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.831950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd40c5-9a38-4cf9-8f60-2d144aade177 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.832242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd40c5-9a38-4cf9-8f60-2d144aade177 admin admin] PATH_INFO: `/v3/groups/9f3cc080129945f0843e3dba25c25cab` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.833479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd40c5-9a38-4cf9-8f60-2d144aade177 admin admin] RBAC: Authorizing `identity:get_group(group_id=9f3cc080129945f0843e3dba25c25cab)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:15.835304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd40c5-9a38-4cf9-8f60-2d144aade177 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:15.836723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 164/328] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:15 2022] GET /identity/v3/groups/9f3cc080129945f0843e3dba25c25cab => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:15.841814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:15.851249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c16c5-b6f6-46c9-acd0-955256269276 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:15.855193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48604f1b-d327-4453-9327-22a867f0bc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:15.855745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48604f1b-d327-4453-9327-22a867f0bc20 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:15.856079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48604f1b-d327-4453-9327-22a867f0bc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:15.856368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48604f1b-d327-4453-9327-22a867f0bc20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:15.857133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48604f1b-d327-4453-9327-22a867f0bc20 admin admin] RBAC: Adding query filter params (group.id=9f3cc080129945f0843e3dba25c25cab, role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:15.857439 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48604f1b-d327-4453-9327-22a867f0bc20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:15.859244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48604f1b-d327-4453-9327-22a867f0bc20 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:15.865631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 165/329] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:27:15 2022] GET /identity/v3/role_assignments?group.id=9f3cc080129945f0843e3dba25c25cab&scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2&role.id=5469eafdf12343518fe61660749f0e85 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:18.097428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1682ba-c9cd-4498-9ec9-0c8d49af8dca None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.097990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1682ba-c9cd-4498-9ec9-0c8d49af8dca None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.097990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1682ba-c9cd-4498-9ec9-0c8d49af8dca None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.100441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 165/330] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:18.105712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb7042-f429-4338-844b-7effb1686804 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.106120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb7042-f429-4338-844b-7effb1686804 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.106289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb7042-f429-4338-844b-7effb1686804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.128149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-caeb7042-f429-4338-844b-7effb1686804 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:18.129299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-caeb7042-f429-4338-844b-7effb1686804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:18.136677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 166/331] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:18.159670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1682ba-c9cd-4498-9ec9-0c8d49af8dca None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.171239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1682ba-c9cd-4498-9ec9-0c8d49af8dca None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.175180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.175917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.176240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.176519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.187808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:18.194902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:18.196149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 166/332] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:27:18.201345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb7042-f429-4338-844b-7effb1686804 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.210338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb7042-f429-4338-844b-7effb1686804 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.214558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.215145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.215437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.215725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.216479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:18.216783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.218361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:18.226820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 167/333] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:18.232120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.241976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42d00b-6bef-421e-93de-058ce8904576 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.245940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.246494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.246784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.247071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.254503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.256799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:18.265003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 167/334] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:27:18.270012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.279467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbc9b5-4b84-447d-ac6e-1a2ec188b450 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.283434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.284234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.284523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.284806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] PATH_INFO: `/v3/projects/34ddce90037c4fbb82757aded33c6c12` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.285877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] RBAC: Authorizing `identity:get_project(project_id=34ddce90037c4fbb82757aded33c6c12)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.287653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:18.289158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 168/335] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/projects/34ddce90037c4fbb82757aded33c6c12 => generated 344 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:18.293942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.301967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61206a-7a19-4c9d-b7fe-b9560efa9d99 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.306182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392c383-bb1a-4bd5-8299-27135552994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.306931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392c383-bb1a-4bd5-8299-27135552994c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.307220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392c383-bb1a-4bd5-8299-27135552994c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.307502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392c383-bb1a-4bd5-8299-27135552994c admin admin] PATH_INFO: `/v3/groups/0d990ea91a484b02a337990415c3012c` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.311915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392c383-bb1a-4bd5-8299-27135552994c admin admin] RBAC: Authorizing `identity:get_group(group_id=0d990ea91a484b02a337990415c3012c)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.313756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392c383-bb1a-4bd5-8299-27135552994c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:18.315152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 168/336] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/groups/0d990ea91a484b02a337990415c3012c => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:18.320713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:18.329503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989840ee-a68e-415c-a7c1-d39b6e21be81 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:18.334050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807aabd-4b24-4c05-b130-3e911d0c6266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:18.334609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807aabd-4b24-4c05-b130-3e911d0c6266 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:18.334898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807aabd-4b24-4c05-b130-3e911d0c6266 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:18.335180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807aabd-4b24-4c05-b130-3e911d0c6266 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:18.335967 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807aabd-4b24-4c05-b130-3e911d0c6266 admin admin] RBAC: Adding query filter params (group.id=0d990ea91a484b02a337990415c3012c, role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=34ddce90037c4fbb82757aded33c6c12) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:18.336276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807aabd-4b24-4c05-b130-3e911d0c6266 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:18.338073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807aabd-4b24-4c05-b130-3e911d0c6266 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:18.343147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 169/337] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:27:18 2022] GET /identity/v3/role_assignments?group.id=0d990ea91a484b02a337990415c3012c&scope.project.id=34ddce90037c4fbb82757aded33c6c12&role.id=3224d4d734484fac94d0c30f0093a334 => generated 260 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:20.421833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b452ddb-3a0a-4570-8b2b-62697ea46d0a None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.422363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b452ddb-3a0a-4570-8b2b-62697ea46d0a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.422473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b452ddb-3a0a-4570-8b2b-62697ea46d0a None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.424078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 169/338] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:20.429495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f30ee-2326-481b-b9de-421f1804473e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.429926 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f30ee-2326-481b-b9de-421f1804473e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.430075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f30ee-2326-481b-b9de-421f1804473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.452132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2e4f30ee-2326-481b-b9de-421f1804473e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:20.453273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2e4f30ee-2326-481b-b9de-421f1804473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:20.460929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 170/339] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:20.483435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b452ddb-3a0a-4570-8b2b-62697ea46d0a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:20.495866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b452ddb-3a0a-4570-8b2b-62697ea46d0a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:20.499856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:20.500619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.500913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.501198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.513479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:20.519835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:20.522188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 170/340] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:20.527886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f30ee-2326-481b-b9de-421f1804473e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:20.536423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f30ee-2326-481b-b9de-421f1804473e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:20.540459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:20.541045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.541335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.541616 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.542322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:20.542621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:20.544226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:20.552920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 171/341] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:20.557996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:20.568083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323be9d-9a96-4098-b8d8-ba3b10b4390d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:20.572170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:20.572933 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.573225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.573512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] PATH_INFO: `/v3/groups/0d990ea91a484b02a337990415c3012c` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.574594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] RBAC: Authorizing `identity:get_group(group_id=0d990ea91a484b02a337990415c3012c)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:20.576512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:20.577930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 171/342] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:20 2022] GET /identity/v3/groups/0d990ea91a484b02a337990415c3012c => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:20.582825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:20.592403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197ba7-6ce5-45e1-8888-54892fa60161 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:20.596383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db83f4-fe24-4f21-b599-0d1b0bf561f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:20.597138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db83f4-fe24-4f21-b599-0d1b0bf561f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.597425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db83f4-fe24-4f21-b599-0d1b0bf561f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.597707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db83f4-fe24-4f21-b599-0d1b0bf561f5 admin admin] PATH_INFO: `/v3/projects/34ddce90037c4fbb82757aded33c6c12` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.598767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db83f4-fe24-4f21-b599-0d1b0bf561f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=34ddce90037c4fbb82757aded33c6c12)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:20.600651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db83f4-fe24-4f21-b599-0d1b0bf561f5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:20.602111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 172/343] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:20 2022] GET /identity/v3/projects/34ddce90037c4fbb82757aded33c6c12 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:20.607098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:20.615937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d84f4-d8c3-4966-9dc4-6858008b67e7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:20.619909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f68f2b-8b52-4721-bac7-06eb90dd1ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:20.620702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f68f2b-8b52-4721-bac7-06eb90dd1ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:20.620989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f68f2b-8b52-4721-bac7-06eb90dd1ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:20.621271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f68f2b-8b52-4721-bac7-06eb90dd1ef5 admin admin] PATH_INFO: `/v3/projects/34ddce90037c4fbb82757aded33c6c12/groups/0d990ea91a484b02a337990415c3012c/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:20.623012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f68f2b-8b52-4721-bac7-06eb90dd1ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ddce90037c4fbb82757aded33c6c12, group_id=0d990ea91a484b02a337990415c3012c, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:20.625590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f68f2b-8b52-4721-bac7-06eb90dd1ef5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:20.637855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 172/344] 10.222.0.23 () {58 vars in 1463 bytes} [Fri Apr 8 02:27:20 2022] PUT /identity/v3/projects/34ddce90037c4fbb82757aded33c6c12/groups/0d990ea91a484b02a337990415c3012c/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:27:22.780600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b23364-531c-4574-a32a-4bcd0791c908 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:22.781091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b23364-531c-4574-a32a-4bcd0791c908 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:22.781091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b23364-531c-4574-a32a-4bcd0791c908 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:22.782764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 173/345] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:22.788133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4b2b-4529-487f-a697-3bee46461aad None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:22.788527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4b2b-4529-487f-a697-3bee46461aad None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:22.788707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4b2b-4529-487f-a697-3bee46461aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:22.810880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-dd2e4b2b-4529-487f-a697-3bee46461aad None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:22.812055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-dd2e4b2b-4529-487f-a697-3bee46461aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:22.874211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 173/346] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:22.897913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b23364-531c-4574-a32a-4bcd0791c908 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:22.909487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b23364-531c-4574-a32a-4bcd0791c908 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:22.913901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:22.914611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:22.914906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:22.915197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:22.926962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:22.936391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:22.937998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 174/347] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:22.944814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4b2b-4529-487f-a697-3bee46461aad None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:22.954196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4b2b-4529-487f-a697-3bee46461aad None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:22.958319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:22.958907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:22.959196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:22.959479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:22.960227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:22.960529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:22.962102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:22.970418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 174/348] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:22.975736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:22.985013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993406c0-e303-4a75-8289-a660416ea684 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:22.989528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:22.990095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:22.990386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:22.990673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:22.998235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:22.999982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:23.008936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 175/349] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:22 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:23.014115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.023198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee99c4-aa86-41be-8945-eb2364ef3ec8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.027250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.028061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.028357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.028649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] PATH_INFO: `/v3/projects/34ddce90037c4fbb82757aded33c6c12` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.029738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=34ddce90037c4fbb82757aded33c6c12)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.031548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:23.033037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 175/350] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/projects/34ddce90037c4fbb82757aded33c6c12 => generated 344 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:23.037982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.046099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006875-6252-4f46-888d-4d834555a56c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.050137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c299ea-3fdd-4f3c-9b54-a89bf88fa043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.050916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c299ea-3fdd-4f3c-9b54-a89bf88fa043 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.051206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c299ea-3fdd-4f3c-9b54-a89bf88fa043 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.052033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c299ea-3fdd-4f3c-9b54-a89bf88fa043 admin admin] PATH_INFO: `/v3/groups/0d990ea91a484b02a337990415c3012c` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.053461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c299ea-3fdd-4f3c-9b54-a89bf88fa043 admin admin] RBAC: Authorizing `identity:get_group(group_id=0d990ea91a484b02a337990415c3012c)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.055279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c299ea-3fdd-4f3c-9b54-a89bf88fa043 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:23.056709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 176/351] 10.222.0.23 () {56 vars in 1201 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/groups/0d990ea91a484b02a337990415c3012c => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:23.061769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:23.071269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d547b6-119c-4f2f-93ed-8f770a6670b1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:23.075270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd741e2b-54f3-46fa-af38-e17f7a1b3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:23.075830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd741e2b-54f3-46fa-af38-e17f7a1b3408 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:23.076158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd741e2b-54f3-46fa-af38-e17f7a1b3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:23.076448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd741e2b-54f3-46fa-af38-e17f7a1b3408 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:23.077217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd741e2b-54f3-46fa-af38-e17f7a1b3408 admin admin] RBAC: Adding query filter params (group.id=0d990ea91a484b02a337990415c3012c, role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=34ddce90037c4fbb82757aded33c6c12) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:23.077525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd741e2b-54f3-46fa-af38-e17f7a1b3408 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:23.079292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd741e2b-54f3-46fa-af38-e17f7a1b3408 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:23.085127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 176/352] 10.222.0.23 () {56 vars in 1397 bytes} [Fri Apr 8 02:27:23 2022] GET /identity/v3/role_assignments?group.id=0d990ea91a484b02a337990415c3012c&scope.project.id=34ddce90037c4fbb82757aded33c6c12&role.id=3224d4d734484fac94d0c30f0093a334 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:26.372601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504c49-c033-47bc-8c63-d42ffc900d4f None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:26.373127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504c49-c033-47bc-8c63-d42ffc900d4f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:26.373211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f504c49-c033-47bc-8c63-d42ffc900d4f None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:26.374841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 177/353] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:26.380537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a086-9ffd-4f1f-bcad-6d502b0fb42a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:26.380910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a086-9ffd-4f1f-bcad-6d502b0fb42a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:26.381116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a086-9ffd-4f1f-bcad-6d502b0fb42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:26.403215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-0642a086-9ffd-4f1f-bcad-6d502b0fb42a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:26.404396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0642a086-9ffd-4f1f-bcad-6d502b0fb42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:26.411180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 177/354] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:26 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:26.434532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504c49-c033-47bc-8c63-d42ffc900d4f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:26.446578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f504c49-c033-47bc-8c63-d42ffc900d4f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:26.450513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:26.451221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:26.451518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:26.451804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:26.463875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:26.465726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:26.482298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:26.483394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 178/355] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:26.489256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a086-9ffd-4f1f-bcad-6d502b0fb42a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:26.497800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a086-9ffd-4f1f-bcad-6d502b0fb42a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:26.501907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5fa4b-2cb4-4247-8282-44a3d71b0573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:26.502493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5fa4b-2cb4-4247-8282-44a3d71b0573 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:26.502787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5fa4b-2cb4-4247-8282-44a3d71b0573 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:26.503075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5fa4b-2cb4-4247-8282-44a3d71b0573 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:26.503765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5fa4b-2cb4-4247-8282-44a3d71b0573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:26.504111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5fa4b-2cb4-4247-8282-44a3d71b0573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:26.506183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5fa4b-2cb4-4247-8282-44a3d71b0573 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:26.518260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 178/356] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:26.527803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:26.537487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b8580-22be-4356-9733-c2d9ca1a2cc3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:26.541447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103c0ad-30a5-47b4-88ac-f435e9fa11bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:26.542030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103c0ad-30a5-47b4-88ac-f435e9fa11bc admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:26.542317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103c0ad-30a5-47b4-88ac-f435e9fa11bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:26.542596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103c0ad-30a5-47b4-88ac-f435e9fa11bc admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:26.543234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103c0ad-30a5-47b4-88ac-f435e9fa11bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:26.544260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-3103c0ad-30a5-47b4-88ac-f435e9fa11bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:26.544260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:26.544260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:26.545441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103c0ad-30a5-47b4-88ac-f435e9fa11bc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:26.570112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 179/357] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:27:26 2022] POST /identity/v3/users => generated 246 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:28.681357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7315-4801-4727-9986-8435e9a6408f None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.681872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7315-4801-4727-9986-8435e9a6408f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.681957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba7315-4801-4727-9986-8435e9a6408f None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.683590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 179/358] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:28.688738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c9d1-04b1-49d2-8bca-a2fad027b302 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.689122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c9d1-04b1-49d2-8bca-a2fad027b302 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.689309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91c9d1-04b1-49d2-8bca-a2fad027b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.712282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-ad91c9d1-04b1-49d2-8bca-a2fad027b302 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:28.713425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ad91c9d1-04b1-49d2-8bca-a2fad027b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:28.720240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 180/359] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:28 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:28.742812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba7315-4801-4727-9986-8435e9a6408f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.754257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba7315-4801-4727-9986-8435e9a6408f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.758907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.759618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.759914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.760228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.771735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:28.778242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:27:28.779311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 180/360] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:28.784932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c9d1-04b1-49d2-8bca-a2fad027b302 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.793362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91c9d1-04b1-49d2-8bca-a2fad027b302 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.797435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.798019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.798311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.798595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.799304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:28.799605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.801240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:28.809692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 181/361] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:28.814614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.824680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a0113-5ece-4189-90d9-956c44a2e2bc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.828718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.829410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.829705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.829994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.841813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.845202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:28.865511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:28.866587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 181/362] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:28.871891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.881666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c344f-3e87-4198-8c59-50126471b40e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.885735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.886314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.886604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.886890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.887576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:28.887878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.888901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:28.888901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:28.888901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:28.889786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:28.902578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 182/363] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:28.907556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.917072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda90d0a-4103-4b5f-9866-c11da43cd40f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.921103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.921800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.922091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.922375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.937024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.939004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:28.957080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:27:28.958656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 182/364] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:28.963737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:28.972880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beecc66-012f-4583-89f7-f3417346c492 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:28.976998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:28.977578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:28.977868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:28.978150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:28.978929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:28.979231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:28.980253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:28.980253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:28.980253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:28.981378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:29.011616 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 183/365] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:27:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:29.016705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:29.026656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b68d2-768d-4950-8474-e2e34da1a11f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:29.030631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:29.031186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:29.031474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:29.031760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:29.039687 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:29.041419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:29.049560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 183/366] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:29 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:29.056162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:29.065120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec2dfa-e8b3-4998-b378-bcad6f6c0dab admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:29.069990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:29.070692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:29.070985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:29.071269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:29.082643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:29.084525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:29.100933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:29.101987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 184/367] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:29.107294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:29.116427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452c50d-7222-4fc3-a0cb-b0894665008a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:29.120515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:29.121094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:29.121388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:29.121677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:29.122361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:29.122671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:29.124277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:29.137648 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 184/368] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:29.143032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:29.152976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a48e0-3e7d-499a-9a71-394ffa31e1e3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:29.157048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:29.157756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:29.158041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:29.158320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:29.168367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:29.170315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:29.184822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:27:29.185864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 185/369] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:29.191409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:29.201226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aabc43-dc2b-40a9-b715-2464edf41f9c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:29.205213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:29.205788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:29.206086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:29.206370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:29.207108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:29.207411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:29.208505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:29.208505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:27:29.208505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:27:29.209607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fd1cc-6882-4f42-bb0f-66509c918137 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:29.221923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 185/370] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:29.227512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:29.236631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea532d-54a5-4f4c-a872-9b9b2c588137 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:29.242306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e288b5-01dc-4e90-93f3-39b10584912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:29.243098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e288b5-01dc-4e90-93f3-39b10584912f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:29.243481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e288b5-01dc-4e90-93f3-39b10584912f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:29.243767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e288b5-01dc-4e90-93f3-39b10584912f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:29.244588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e288b5-01dc-4e90-93f3-39b10584912f admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=f724e05a70194ed992e73c9ca77eaef3) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:29.244893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e288b5-01dc-4e90-93f3-39b10584912f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:29.246699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e288b5-01dc-4e90-93f3-39b10584912f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:29.252416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 186/371] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:29 2022] GET /identity/v3/role_assignments?user.id=f724e05a70194ed992e73c9ca77eaef3&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:31.333205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f797-241c-4f49-9066-3ba673a2ca3b None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.333822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f797-241c-4f49-9066-3ba673a2ca3b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.333822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6f797-241c-4f49-9066-3ba673a2ca3b None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.335446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 186/372] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:31.340532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef963-7e34-4348-afc8-543b758a0e6c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.340909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef963-7e34-4348-afc8-543b758a0e6c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.341102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ef963-7e34-4348-afc8-543b758a0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.363460 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f87ef963-7e34-4348-afc8-543b758a0e6c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:31.364687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f87ef963-7e34-4348-afc8-543b758a0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:31.371687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 187/373] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:31 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:31.393909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f797-241c-4f49-9066-3ba673a2ca3b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.406221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6f797-241c-4f49-9066-3ba673a2ca3b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.410146 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.411450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.411739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.412077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.422962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:31.429911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:27:31.430980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 187/374] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:31.436302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef963-7e34-4348-afc8-543b758a0e6c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.445154 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ef963-7e34-4348-afc8-543b758a0e6c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.449172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.449782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.450070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.450351 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.451058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:31.451356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.452950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.462216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 188/375] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:31.467290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.477459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5ce32-ff2a-4dc9-826f-31988acbd7a0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.482020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.482182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.482473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.482756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.493869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.495683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.513010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:31.514079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 188/376] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:31.519365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.528856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfed492-28b8-4c1c-8762-cdd769a15fbe admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.532890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.533473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.533765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.534052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.534738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:31.535043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.537240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.549319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 189/377] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:31.555346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.564295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dca95-a71b-4f6f-afa6-184b0cede85e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.568771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.569464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.569750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.570031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.582208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.584811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.602820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:27:31.603851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 189/378] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:31.609161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.618894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9e977-dc75-4625-ad5c-1b4c90b13d1d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.622916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.623496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.623787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.624108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.624889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:31.625192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.626986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.654464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 190/379] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:31.659427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.669470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58749-b0a7-41c9-ba72-5a8b84cc1448 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.673446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.674141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.674429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.674710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.686830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.688654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.705997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:31.707000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 190/380] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:31.712668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.721614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f459-81f7-4c77-a134-0f33aa35c8ea admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.725775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.726346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.726635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.726919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.727594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:31.727896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.729477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.741293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 191/381] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:31.746107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.756008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807de805-2a91-463e-ac36-c0a224bef6d4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.759968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.760657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.760945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.761229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.769309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.772313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.785495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:27:31.786954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 191/382] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:27:31.792219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.801344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6bbaa-c7ed-48fb-8bdc-e490ce460565 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.805643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.806210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.806502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.806789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.807523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:31.807828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.808834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:31.808834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:31.808834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:31.809946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce83d8e-3725-4c3d-8ae1-d2a61ce3d729 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.823049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 192/383] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:27:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:31.828267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:31.838171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f88c2-ce9c-4fab-adf2-c884a2bb251a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:31.842070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e8df9-babd-439d-af33-00113022d006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:31.842854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8df9-babd-439d-af33-00113022d006 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:31.843141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8df9-babd-439d-af33-00113022d006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:31.843422 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e8df9-babd-439d-af33-00113022d006 admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/f724e05a70194ed992e73c9ca77eaef3/roles/58f38def815542948bd51acfd4644ea3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:31.863093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e8df9-babd-439d-af33-00113022d006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=f724e05a70194ed992e73c9ca77eaef3, role_id=58f38def815542948bd51acfd4644ea3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:31.866176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e8df9-babd-439d-af33-00113022d006 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:31.878126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 192/384] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:31 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/f724e05a70194ed992e73c9ca77eaef3/roles/58f38def815542948bd51acfd4644ea3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:27:33.975049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0dbae-58fa-46f6-8821-e6a783d94d27 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:33.975600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0dbae-58fa-46f6-8821-e6a783d94d27 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:33.975600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0dbae-58fa-46f6-8821-e6a783d94d27 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:33.977334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 193/385] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:33.982476 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2387f-1792-463c-bbdc-802c2198841f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:33.982887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2387f-1792-463c-bbdc-802c2198841f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:33.983061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2387f-1792-463c-bbdc-802c2198841f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.005353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-93e2387f-1792-463c-bbdc-802c2198841f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:34.006499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-93e2387f-1792-463c-bbdc-802c2198841f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:34.068801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 193/386] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:33 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:34.093330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0dbae-58fa-46f6-8821-e6a783d94d27 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.105145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0dbae-58fa-46f6-8821-e6a783d94d27 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.109057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.109765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.110055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.110339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.121240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:34.127604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:27:34.128771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 194/387] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:34.134922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2387f-1792-463c-bbdc-802c2198841f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.143403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2387f-1792-463c-bbdc-802c2198841f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.148287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.148872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.149165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.149451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.150163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:34.150465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.152068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.162012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 194/388] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:34.165802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.175417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3d6f-e862-4aba-97d8-6bed305386bf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.180445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.181142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.181436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.181723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.194212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.196071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.213404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:34.214481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 195/389] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:34.219888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.229658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c5f9a-1b89-461a-8ea7-2c844b3c5451 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.233896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.234665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.234959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.235343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.235952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:34.236313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.237898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.265119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 195/390] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:34.270997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.280528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc3bfa-fc4a-48d5-9f1c-189b9f5fa8ff admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.284504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.285210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.285934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.285934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.298794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.300840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.319203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:27:34.320283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 196/391] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:34.325699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.334934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e161f-5e5e-4c85-a246-edcbfe10c774 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.338979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.339567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.339859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.340176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.340969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:34.341274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.342267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:34.342267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:27:34.342267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:27:34.343388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.463265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 196/392] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:34.468760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.478209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7d61-4c13-4ba8-869c-6ff6f6543dd6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.482317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.482833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.483126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.483410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.491749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.493551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.501900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 197/393] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:34.507871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.517045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc16713-fee9-4c9e-a543-310a6c6ff774 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.521289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.521999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.522291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.522577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.533841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.536211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.554044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:34.555228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 197/394] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:34.561698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.571524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c272b4c-79dc-4557-becb-67a8c03c8615 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.575612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.576224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.576513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.576801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.577482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:34.577780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.579350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.592069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 198/395] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:34.597420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.607175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d52b4-3cd1-4457-ad59-9b924ca2583e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.611184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.611893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.612217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.612499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.621397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.623351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.636633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:27:34.637674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 198/396] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:34.642736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.652393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbcc46-ad45-4a73-b124-619aef814e9d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.656422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f71937-5ae4-4ac3-91de-8587aa53669c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.656993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f71937-5ae4-4ac3-91de-8587aa53669c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.657282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f71937-5ae4-4ac3-91de-8587aa53669c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.657565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f71937-5ae4-4ac3-91de-8587aa53669c admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.658298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f71937-5ae4-4ac3-91de-8587aa53669c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:34.658598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f71937-5ae4-4ac3-91de-8587aa53669c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.661404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f71937-5ae4-4ac3-91de-8587aa53669c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.674735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 199/397] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:34.680950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:34.689916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ecf07-cd0b-4dd7-80a4-4a1048f0ebc0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:34.694186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82827-215f-45e5-a05d-5f36e6465a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:34.694758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82827-215f-45e5-a05d-5f36e6465a7e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:34.695052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82827-215f-45e5-a05d-5f36e6465a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:34.695342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82827-215f-45e5-a05d-5f36e6465a7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:34.696159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f82827-215f-45e5-a05d-5f36e6465a7e admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=f724e05a70194ed992e73c9ca77eaef3) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:34.696470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f82827-215f-45e5-a05d-5f36e6465a7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:34.698288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f82827-215f-45e5-a05d-5f36e6465a7e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:34.703913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 199/398] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:34 2022] GET /identity/v3/role_assignments?user.id=f724e05a70194ed992e73c9ca77eaef3&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:36.845472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fa04-e492-4ef9-b37c-b024de89a1bf None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:36.846002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fa04-e492-4ef9-b37c-b024de89a1bf None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:36.846092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7fa04-e492-4ef9-b37c-b024de89a1bf None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:36.847689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 200/399] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:36.853254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20e722-6887-4ed0-a48b-0bf38bbc4c7d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:36.853623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20e722-6887-4ed0-a48b-0bf38bbc4c7d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:36.853835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20e722-6887-4ed0-a48b-0bf38bbc4c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:36.876259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-da20e722-6887-4ed0-a48b-0bf38bbc4c7d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:36.877415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-da20e722-6887-4ed0-a48b-0bf38bbc4c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:36.884319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 200/400] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:36.906521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fa04-e492-4ef9-b37c-b024de89a1bf None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:36.918725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7fa04-e492-4ef9-b37c-b024de89a1bf None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:36.922612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:36.923315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:36.923604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:36.923887 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:36.935528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:36.941886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:36.942940 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 201/401] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:36.948387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20e722-6887-4ed0-a48b-0bf38bbc4c7d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:36.956789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20e722-6887-4ed0-a48b-0bf38bbc4c7d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:36.960874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:36.961459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:36.961756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:36.962048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:36.962763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:36.963069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:36.964701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:36.973605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 201/402] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:36.978596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:36.988104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa790eb2-ddae-4334-90e3-3ca3333018c4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:36.992715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:36.993399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:36.993689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:36.993971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.004893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.006688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.023474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:37.024533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 202/403] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:37.029690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.039263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf8bc1-84d5-49b3-9839-b96eb363ecd4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.043270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.043836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.044163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.044455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.045137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:37.045443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.047028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.060038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 202/404] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.064858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.073839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc205b6-769c-49f0-b001-3d7a68db73a8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.077890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.078604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.078898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.079187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.091478 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.093492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.111310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:27:37.112322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 203/405] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:37.118127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.127073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641cf9f-e437-4e9d-ae5d-36591f514a71 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.131227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.131800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.132132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.132420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.133199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:37.133502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.135284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.163937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 203/406] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.168997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.178524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8233c-fdbf-42eb-a565-494137b9c038 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.182484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.183042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.183330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.183612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.191221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.193137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.201374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 204/407] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:37.206538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.216552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c2e03-d511-41cf-a413-250ba090d280 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.220646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.221356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.221651 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.221940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.233894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.235703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.252384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:37.253422 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 204/408] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:27:37.258306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.266517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb762b37-839c-4a99-b880-716715882782 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.271149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.271712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.272038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.272322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.272993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:37.273291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.274836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.287592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 205/409] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.292425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.301603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e637-cf44-4280-bd4f-0f09514cd67f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.305963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.306654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.306947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.307236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.315443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.317401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.330896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:27:37.331969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 205/410] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:37.337439 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.346225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedba84-a1f6-45cc-80ec-c4bf09b78b76 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.350827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f7f7a-012c-4bac-b8de-296c4d00da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.351383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f7f7a-012c-4bac-b8de-296c4d00da29 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.351671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f7f7a-012c-4bac-b8de-296c4d00da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.351975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f7f7a-012c-4bac-b8de-296c4d00da29 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.352702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f7f7a-012c-4bac-b8de-296c4d00da29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:37.353001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f7f7a-012c-4bac-b8de-296c4d00da29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.354761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f7f7a-012c-4bac-b8de-296c4d00da29 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.367212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 206/411] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:37.372560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:37.381679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e52ce-454c-4035-931a-cf58eef0d0a0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:37.385669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ed144-282a-445b-a3ee-a4999789a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:37.386225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ed144-282a-445b-a3ee-a4999789a868 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:37.386515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ed144-282a-445b-a3ee-a4999789a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:37.386798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ed144-282a-445b-a3ee-a4999789a868 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:37.387572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ed144-282a-445b-a3ee-a4999789a868 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=f724e05a70194ed992e73c9ca77eaef3) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:37.387877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ed144-282a-445b-a3ee-a4999789a868 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:37.389697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ed144-282a-445b-a3ee-a4999789a868 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:37.395365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 206/412] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:37 2022] GET /identity/v3/role_assignments?user.id=f724e05a70194ed992e73c9ca77eaef3&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:39.475288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3ba0-afd6-487c-b70b-b005c37d14c2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.475801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3ba0-afd6-487c-b70b-b005c37d14c2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.475884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad3ba0-afd6-487c-b70b-b005c37d14c2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.477553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 207/413] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:39.482702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619995-e606-47ae-8bf0-29374acf5281 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.483098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619995-e606-47ae-8bf0-29374acf5281 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.483655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0619995-e606-47ae-8bf0-29374acf5281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.506137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a0619995-e606-47ae-8bf0-29374acf5281 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:39.507349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a0619995-e606-47ae-8bf0-29374acf5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:39.514142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 207/414] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:39.536161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad3ba0-afd6-487c-b70b-b005c37d14c2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.547684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad3ba0-afd6-487c-b70b-b005c37d14c2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.552255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.553224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.553515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.553799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.564632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:39.571784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:39.572873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 208/415] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:39.578319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619995-e606-47ae-8bf0-29374acf5281 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.586852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0619995-e606-47ae-8bf0-29374acf5281 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.590909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.591489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.591780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.592210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.592921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:39.593225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.594800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.603187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 208/416] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:39.608176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.618431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed3f28-d132-47ae-bb3d-b24809d94234 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.622500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.623194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.623487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.623777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.635502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.637342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.654092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:39.655126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 209/417] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:39.660165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.669041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2740d5-790e-43f9-b229-611355c2f950 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.673037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.673601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.673889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.674171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.674839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:39.675137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.677200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.689332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 209/418] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:39.694884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.703848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f144-4656-49b5-b3bc-860e510ee29c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.707959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.708647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.708937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.709223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.721490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.723513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.741251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:27:39.742231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 210/419] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:39.747320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.757123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cae72-ec5e-43e4-807c-613b2b7fc915 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.761217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.761797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.762090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.762377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.763165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:39.763468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.765288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.794637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 210/420] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:39.799953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.810079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f25cde-a4d6-41b8-a0a2-337defe38578 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.814111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.814815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.815109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.815397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.826984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.828845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.845258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:39.846300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 211/421] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:39.851953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.860966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12c831-f679-4d57-b439-e62830b93d7c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.865186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.865761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.866052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.866338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.867016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:39.867315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.868906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.881074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 211/422] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:39.886148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.895340 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e3636-4528-49c7-8990-c78c923ab514 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.899355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.900084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.900376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.900663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.908894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.911749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.924985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:27:39.926604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 212/423] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:39.932151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.941106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6271554-8036-4f00-aaba-d96b9f7ba2e9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.945168 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881acf8-1736-48d1-8fc8-a4f754068ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.945729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881acf8-1736-48d1-8fc8-a4f754068ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.946021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881acf8-1736-48d1-8fc8-a4f754068ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.946308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881acf8-1736-48d1-8fc8-a4f754068ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.947043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881acf8-1736-48d1-8fc8-a4f754068ff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:39.947344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881acf8-1736-48d1-8fc8-a4f754068ff4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.949182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881acf8-1736-48d1-8fc8-a4f754068ff4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.961402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 212/424] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:39.966660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:39.976140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91a6e5-6fad-4baa-b8a9-fc19b4cf702e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:39.980163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b734780-38e8-491e-9438-f47c9d595ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:39.980980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b734780-38e8-491e-9438-f47c9d595ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:39.981296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b734780-38e8-491e-9438-f47c9d595ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:39.981582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b734780-38e8-491e-9438-f47c9d595ecb admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/f724e05a70194ed992e73c9ca77eaef3/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:39.983337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b734780-38e8-491e-9438-f47c9d595ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=f724e05a70194ed992e73c9ca77eaef3, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:39.985945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b734780-38e8-491e-9438-f47c9d595ecb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:39.998275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 213/425] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:27:39 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/f724e05a70194ed992e73c9ca77eaef3/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:27:42.053491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63b9aa-4dd9-4e04-af89-7801a3297472 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.054026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63b9aa-4dd9-4e04-af89-7801a3297472 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.054142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63b9aa-4dd9-4e04-af89-7801a3297472 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.055712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 213/426] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:42.060969 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206b78-2a7a-4301-b86a-78652143a447 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.061401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206b78-2a7a-4301-b86a-78652143a447 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.061537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206b78-2a7a-4301-b86a-78652143a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.085160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-89206b78-2a7a-4301-b86a-78652143a447 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:42.086296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-89206b78-2a7a-4301-b86a-78652143a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:42.244541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 214/427] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:42 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:42.267070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63b9aa-4dd9-4e04-af89-7801a3297472 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.278882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63b9aa-4dd9-4e04-af89-7801a3297472 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.282792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.283495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.283801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.284116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.296665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:27:42.304644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:27:42.305654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 214/428] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:42.311368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206b78-2a7a-4301-b86a-78652143a447 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.320506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206b78-2a7a-4301-b86a-78652143a447 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.324612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.325200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.325493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.325781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.326499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:42.326804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.328447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.336847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 215/429] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:42.341784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.352240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bd879-c3a4-41e2-aa16-8a784fec99b9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.356219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.356903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.357190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.357472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.369659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.372264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.389880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:42.390947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 215/430] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:27:42.396979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.406036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa6c95-d2df-4b28-a26e-2ffc6015a0f8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.410016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.411117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.411400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.411847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.412584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:42.412886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.414455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.426629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 216/431] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:42.431823 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.440871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410cac2-808f-49de-b244-8f4233309324 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.445093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.445787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.446077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.446360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.459505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.461542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.479180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:27:42.480268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 216/432] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:27:42.485660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.495204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b162-47e8-4f28-9528-e67abd281c89 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.499314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.499906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.500228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.500517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.501309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:42.501613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.503430 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.531751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 217/433] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:42.537744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.546846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb33bee-6612-4319-9b50-d39efb19d7f7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.551009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.551715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.552039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.552326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.560054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.561722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.569922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 217/434] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:27:42.575140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.585712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a975bde-fe62-4d60-b002-bc6742f770af admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.591284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.592032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.592330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.592623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.605284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.607100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.623722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:27:42.624813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 218/435] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:42.630328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.638841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7ca3e-3991-4d82-9868-120066c42734 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.642936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.643509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.643797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.644110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.645522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:42.645817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.647370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.659475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 218/436] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:42.665173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.674183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4d367-a46a-46fb-9cf5-13af76222b0e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.678655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.679352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.679642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.679940 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.688139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.690052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.703528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:27:42.704585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 219/437] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:42.710360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.719289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387bee2-402d-47b4-ab75-693464a49b0a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.723955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97385ee7-dca2-4ee8-86eb-42a37949b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.724517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97385ee7-dca2-4ee8-86eb-42a37949b697 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.724806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97385ee7-dca2-4ee8-86eb-42a37949b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.725090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97385ee7-dca2-4ee8-86eb-42a37949b697 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.725817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97385ee7-dca2-4ee8-86eb-42a37949b697 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:42.726120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97385ee7-dca2-4ee8-86eb-42a37949b697 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.727911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97385ee7-dca2-4ee8-86eb-42a37949b697 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.739961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 219/438] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:42.745202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:42.754567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716809c-4d93-448c-aff3-beaa64d79e8d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:42.758740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd4fac-6df4-4837-84a2-870362a3dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:42.759302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd4fac-6df4-4837-84a2-870362a3dd52 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:42.759593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd4fac-6df4-4837-84a2-870362a3dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:42.759876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd4fac-6df4-4837-84a2-870362a3dd52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:42.760683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd4fac-6df4-4837-84a2-870362a3dd52 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=f724e05a70194ed992e73c9ca77eaef3) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:42.760987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd4fac-6df4-4837-84a2-870362a3dd52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:42.762762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd4fac-6df4-4837-84a2-870362a3dd52 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:42.768292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 220/439] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:27:42 2022] GET /identity/v3/role_assignments?user.id=f724e05a70194ed992e73c9ca77eaef3&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:44.900104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10fab-3743-4957-8e96-e3d984376b6d None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:44.900626 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10fab-3743-4957-8e96-e3d984376b6d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:44.900711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10fab-3743-4957-8e96-e3d984376b6d None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:44.902345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 220/440] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:44.907597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d470a-1679-4dc2-adbf-b8cda5c5c4fd None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:44.908023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d470a-1679-4dc2-adbf-b8cda5c5c4fd None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:44.908211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d470a-1679-4dc2-adbf-b8cda5c5c4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:44.931672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-291d470a-1679-4dc2-adbf-b8cda5c5c4fd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:44.932878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-291d470a-1679-4dc2-adbf-b8cda5c5c4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:44.940120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 221/441] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:44.962544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10fab-3743-4957-8e96-e3d984376b6d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:44.974838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10fab-3743-4957-8e96-e3d984376b6d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:44.978793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:44.979536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:44.979817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:44.980133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:44.980756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:44.981760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:44.981760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:27:44.981760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:27:44.982640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:44.994036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 08 02:27:44.995072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 221/442] 10.222.0.23 () {56 vars in 1153 bytes} [Fri Apr 8 02:27:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:45.000362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d470a-1679-4dc2-adbf-b8cda5c5c4fd None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:45.009406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d470a-1679-4dc2-adbf-b8cda5c5c4fd None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:45.013502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:45.014082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:45.014375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:45.014659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:45.015335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:45.015639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:45.016691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:45.016691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:45.016691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:45.017561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812f329-9f10-402b-ac77-41c5040287fb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:45.022328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 222/443] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:27:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:45.027536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:45.036543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916f4d8-c8c4-4745-9f6c-2c95725e25bc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:45.040550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:45.041110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:45.041398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:45.041679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:45.042335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:45.042632 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:45.043589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:45.043589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:27:45.043589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:27:45.044477 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8cfe7-308f-49ab-8cc2-1b5a49709e01 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:45.048716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 222/444] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:27:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:47.118658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013ff92-61b0-4d93-b77f-cb3f44e8314e None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:47.119188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013ff92-61b0-4d93-b77f-cb3f44e8314e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:47.119304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013ff92-61b0-4d93-b77f-cb3f44e8314e None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:47.121028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 223/445] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:47.126228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa9c4-6f6a-4e21-b610-ccd42c15c061 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:47.126638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa9c4-6f6a-4e21-b610-ccd42c15c061 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:47.126803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa9c4-6f6a-4e21-b610-ccd42c15c061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:47.149010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7a5fa9c4-6f6a-4e21-b610-ccd42c15c061 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:47.150142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7a5fa9c4-6f6a-4e21-b610-ccd42c15c061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:47.156855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 223/446] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:47 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:47.179664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013ff92-61b0-4d93-b77f-cb3f44e8314e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:47.191265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013ff92-61b0-4d93-b77f-cb3f44e8314e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:47.195183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd518-0683-4405-a55e-896624dbd9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:47.195760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd518-0683-4405-a55e-896624dbd9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:47.196087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd518-0683-4405-a55e-896624dbd9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:47.196371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd518-0683-4405-a55e-896624dbd9c7 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:47.197049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dd518-0683-4405-a55e-896624dbd9c7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:47.198046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-183dd518-0683-4405-a55e-896624dbd9c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:47.198046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:47.198046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:47.198919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dd518-0683-4405-a55e-896624dbd9c7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:47.212414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 224/447] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:27:47 2022] POST /identity/v3/services => generated 269 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:49.342821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97bb8-1529-4f09-aee4-427078d3cd7f None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:49.343347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97bb8-1529-4f09-aee4-427078d3cd7f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:49.343463 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97bb8-1529-4f09-aee4-427078d3cd7f None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:49.345068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 224/448] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:49.350818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175336ca-7125-4b8f-b628-3781d1904ddf None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:49.351231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175336ca-7125-4b8f-b628-3781d1904ddf None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:49.351390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175336ca-7125-4b8f-b628-3781d1904ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:49.372891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-175336ca-7125-4b8f-b628-3781d1904ddf None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:49.374018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-175336ca-7125-4b8f-b628-3781d1904ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:49.390558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 225/449] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:49 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:49.414263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f97bb8-1529-4f09-aee4-427078d3cd7f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:49.425991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f97bb8-1529-4f09-aee4-427078d3cd7f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:49.430174 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:49.430897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:49.431190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:49.431474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:49.432132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:49.433716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:49.444452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 08 02:27:49.445491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 225/450] 10.222.0.23 () {56 vars in 1153 bytes} [Fri Apr 8 02:27:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:49.450848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175336ca-7125-4b8f-b628-3781d1904ddf None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:49.459758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175336ca-7125-4b8f-b628-3781d1904ddf None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:49.463797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:49.464416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:49.464706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:49.464989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:49.465664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:49.465964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:49.467535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:49.471694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 226/451] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:27:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:49.477606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:49.486771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e52014-e15d-47ed-8d45-ea0c3595a348 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:49.490888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:49.491460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:49.491750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:49.492079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:49.492749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:49.493053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:49.494611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:49.499081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 226/452] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:27:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:49.505110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:49.514188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036110a-a900-4dd9-8cd1-fc9c795517ec admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:49.518323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:49.518893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:49.519794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:49.520125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:49.520874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] RBAC: Adding query filter params (interface=public, service_id=a5751cd32d7c4b2285ffe3bfcf3d23b7, region_id=RegionOne) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:49.521183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:49.522184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:49.522184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:49.522184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:49.523053 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd95acc-9f9a-4aaf-a018-d7999cd5d39d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:49.528792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 227/453] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:27:49 2022] GET /identity/v3/endpoints?service_id=a5751cd32d7c4b2285ffe3bfcf3d23b7&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:49.533638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:49.542675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d242a9f-43fd-4b60-9d71-70013a19f487 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:49.546643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e5436-77dd-4156-967f-edc5f799c15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:49.547213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5436-77dd-4156-967f-edc5f799c15f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:49.547505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5436-77dd-4156-967f-edc5f799c15f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:49.547790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e5436-77dd-4156-967f-edc5f799c15f admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:49.548467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e5436-77dd-4156-967f-edc5f799c15f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:49.549997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e5436-77dd-4156-967f-edc5f799c15f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:49.554757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 227/454] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:27:49 2022] GET /identity/v3/services => generated 562 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:51.653548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5eea-1828-45dc-a9fd-676f81b1d137 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.654055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5eea-1828-45dc-a9fd-676f81b1d137 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.654139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd5eea-1828-45dc-a9fd-676f81b1d137 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.655781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 228/455] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:51.660873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6850-34b3-4575-9dc6-ee93b45beb49 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.661310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6850-34b3-4575-9dc6-ee93b45beb49 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.661446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d6850-34b3-4575-9dc6-ee93b45beb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.683838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f61d6850-34b3-4575-9dc6-ee93b45beb49 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:51.685037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f61d6850-34b3-4575-9dc6-ee93b45beb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:51.691982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 228/456] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:51 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:51.714769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd5eea-1828-45dc-a9fd-676f81b1d137 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:51.727145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd5eea-1828-45dc-a9fd-676f81b1d137 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:51.731353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:51.732173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.732415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.732701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.733327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.734324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:51.734324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:27:51.734324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:27:51.735201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:51.746582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 08 02:27:51.747632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 229/457] 10.222.0.23 () {56 vars in 1153 bytes} [Fri Apr 8 02:27:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:51.753122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6850-34b3-4575-9dc6-ee93b45beb49 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:51.762179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d6850-34b3-4575-9dc6-ee93b45beb49 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:51.766226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:51.766874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.767169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.767452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.768156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:51.768458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.770591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:51.774720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 229/458] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:27:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:51.779905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:51.789266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54978af3-3e2f-4852-b018-696119f791a1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:51.793339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71db8e-b184-429e-9135-4dd68fd71a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:51.793908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71db8e-b184-429e-9135-4dd68fd71a10 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.794203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71db8e-b184-429e-9135-4dd68fd71a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.794496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71db8e-b184-429e-9135-4dd68fd71a10 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.795164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71db8e-b184-429e-9135-4dd68fd71a10 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:51.795471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71db8e-b184-429e-9135-4dd68fd71a10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.797061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71db8e-b184-429e-9135-4dd68fd71a10 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:51.801621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 230/459] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:27:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:51.806798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:51.815639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d26fb-0ac4-43c0-8390-b575611be6de admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:51.820580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d3931-f1d4-45ce-8a56-2b66bbf142f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:51.821127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d3931-f1d4-45ce-8a56-2b66bbf142f6 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:51.821416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d3931-f1d4-45ce-8a56-2b66bbf142f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:51.821698 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d3931-f1d4-45ce-8a56-2b66bbf142f6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:51.822393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d3931-f1d4-45ce-8a56-2b66bbf142f6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:51.823349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-745d3931-f1d4-45ce-8a56-2b66bbf142f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:51.823349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:27:51.823349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:27:51.824242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d3931-f1d4-45ce-8a56-2b66bbf142f6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:51.843394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 230/460] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:27:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:27:53.960263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4223-4814-479e-b940-6b60595def01 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.960785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4223-4814-479e-b940-6b60595def01 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.960875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4223-4814-479e-b940-6b60595def01 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.962507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 231/461] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:53.967676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038bbf1-01cd-4b12-ba41-3d04c0954f3f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:53.968136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038bbf1-01cd-4b12-ba41-3d04c0954f3f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:53.968282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038bbf1-01cd-4b12-ba41-3d04c0954f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:53.990852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8038bbf1-01cd-4b12-ba41-3d04c0954f3f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:53.992015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8038bbf1-01cd-4b12-ba41-3d04c0954f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:54.012313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 231/462] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:53 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:54.034735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf4223-4814-479e-b940-6b60595def01 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:54.046446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf4223-4814-479e-b940-6b60595def01 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:54.050402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:54.051108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:54.051397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:54.051682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:54.052347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:54.054179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:54.064319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 08 02:27:54.065356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 232/463] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:54.071307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038bbf1-01cd-4b12-ba41-3d04c0954f3f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:54.079672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038bbf1-01cd-4b12-ba41-3d04c0954f3f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:54.084516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1db78-433b-409f-b283-f63c149682f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:54.085090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1db78-433b-409f-b283-f63c149682f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:54.085378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1db78-433b-409f-b283-f63c149682f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:54.085661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1db78-433b-409f-b283-f63c149682f0 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:54.086327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1db78-433b-409f-b283-f63c149682f0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:54.086629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1db78-433b-409f-b283-f63c149682f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:54.088221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1db78-433b-409f-b283-f63c149682f0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:54.092343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 232/464] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:27:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:54.097554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:54.107029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcffb45-3fa8-4871-8d64-f65571bcd966 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:54.111036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c3107-4d15-4fc5-a3c9-bbbbc6eadaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:54.111590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3107-4d15-4fc5-a3c9-bbbbc6eadaee admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:54.111881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3107-4d15-4fc5-a3c9-bbbbc6eadaee admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:54.112195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3107-4d15-4fc5-a3c9-bbbbc6eadaee admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:54.113100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c3107-4d15-4fc5-a3c9-bbbbc6eadaee admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:54.113400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c3107-4d15-4fc5-a3c9-bbbbc6eadaee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:54.114935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c3107-4d15-4fc5-a3c9-bbbbc6eadaee admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:54.119022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 233/465] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:27:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:56.189584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2255-bbe9-4463-9d0e-419852e3a485 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:56.190105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2255-bbe9-4463-9d0e-419852e3a485 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:56.190189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f2255-bbe9-4463-9d0e-419852e3a485 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:56.191957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 233/466] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:56.197062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81824019-dae6-4e73-ad40-bf76b5981ba0 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:56.197476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81824019-dae6-4e73-ad40-bf76b5981ba0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:56.197643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81824019-dae6-4e73-ad40-bf76b5981ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:56.219612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-81824019-dae6-4e73-ad40-bf76b5981ba0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:56.220795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-81824019-dae6-4e73-ad40-bf76b5981ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:56.228333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 234/467] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:56 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:27:56.249675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2255-bbe9-4463-9d0e-419852e3a485 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:56.261801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f2255-bbe9-4463-9d0e-419852e3a485 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:56.265712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7eced-91a4-4d7f-a1db-9a0deaa13d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:56.266287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7eced-91a4-4d7f-a1db-9a0deaa13d5d admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:56.266584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7eced-91a4-4d7f-a1db-9a0deaa13d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:56.266865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7eced-91a4-4d7f-a1db-9a0deaa13d5d admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:56.267531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7eced-91a4-4d7f-a1db-9a0deaa13d5d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:56.268553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-24a7eced-91a4-4d7f-a1db-9a0deaa13d5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:56.268553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:27:56.268553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:27:56.270190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7eced-91a4-4d7f-a1db-9a0deaa13d5d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:56.282923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 234/468] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:27:56 2022] POST /identity/v3/services => generated 242 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:27:58.370776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59e64-ec1b-45f0-bdf1-1acd95ea744a None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.371336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59e64-ec1b-45f0-bdf1-1acd95ea744a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.371336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f59e64-ec1b-45f0-bdf1-1acd95ea744a None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.373061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 235/469] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:27:58.379077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e568-30f1-40a2-bcad-fc95186fa840 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.379650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e568-30f1-40a2-bcad-fc95186fa840 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.379650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196e568-30f1-40a2-bcad-fc95186fa840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.401396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d196e568-30f1-40a2-bcad-fc95186fa840 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:27:58.402551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d196e568-30f1-40a2-bcad-fc95186fa840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:27:58.418356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 235/470] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:27:58 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:27:58.442147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f59e64-ec1b-45f0-bdf1-1acd95ea744a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:58.453675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f59e64-ec1b-45f0-bdf1-1acd95ea744a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:58.457706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:58.458417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.458708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.458993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.459622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.461231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:58.471360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 08 02:27:58.472547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 236/471] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:27:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:27:58.478142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e568-30f1-40a2-bcad-fc95186fa840 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:58.486735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196e568-30f1-40a2-bcad-fc95186fa840 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:58.491373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:58.491988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.492288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.492577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.493267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:58.493575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.495165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:58.499434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 236/472] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:27:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:58.505533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:58.514613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48206972-9b55-4d5d-b0d4-db874926b34b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:58.518665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:58.519312 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.519607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.519894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.520592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:58.520897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.522472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:58.527308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 237/473] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:27:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:27:58.532391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:58.541923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948ed35-2973-4fae-91a3-26b6cb53feb8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:58.545992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:58.546560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.546855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.547145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.547889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] RBAC: Adding query filter params (interface=public, service_id=6a10700470a54daf8b10410b7709e24c, region_id=RegionOne) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:27:58.548235 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.549210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:27:58.549210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:27:58.549210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:27:58.550773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8695d35d-c1c9-48a4-9597-b8a846138173 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:58.556792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 237/474] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:27:58 2022] GET /identity/v3/endpoints?service_id=6a10700470a54daf8b10410b7709e24c&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:27:58.561648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:27:58.570585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae459cd-206e-4915-b77a-2e64a2c401d7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:27:58.574627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b184eb0-f280-47f7-bb73-a8a4769379fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:27:58.575187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184eb0-f280-47f7-bb73-a8a4769379fa admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:27:58.575476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184eb0-f280-47f7-bb73-a8a4769379fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:27:58.575761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b184eb0-f280-47f7-bb73-a8a4769379fa admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:27:58.576444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b184eb0-f280-47f7-bb73-a8a4769379fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:27:58.577975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b184eb0-f280-47f7-bb73-a8a4769379fa admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:27:58.582976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 238/475] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:27:58 2022] GET /identity/v3/services => generated 792 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:00.684992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad54f0-d785-4c57-adf8-f8ff0583fcd5 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.685571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad54f0-d785-4c57-adf8-f8ff0583fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.685571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad54f0-d785-4c57-adf8-f8ff0583fcd5 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.687217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 238/476] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:00.693819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9c3f-5ec0-43a6-a50c-1cd23f08975f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.694256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9c3f-5ec0-43a6-a50c-1cd23f08975f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.694392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9c3f-5ec0-43a6-a50c-1cd23f08975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.715831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-7edf9c3f-5ec0-43a6-a50c-1cd23f08975f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:00.716985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7edf9c3f-5ec0-43a6-a50c-1cd23f08975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:00.723810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 239/477] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:00 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:00.746279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad54f0-d785-4c57-adf8-f8ff0583fcd5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.758729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad54f0-d785-4c57-adf8-f8ff0583fcd5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.762609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.763314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.763603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.763883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.764525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.766091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:00.776797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 08 02:28:00.777838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 239/478] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:00.783376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9c3f-5ec0-43a6-a50c-1cd23f08975f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.792612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9c3f-5ec0-43a6-a50c-1cd23f08975f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.796655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.797230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.797516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.797798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.798464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:00.798762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.801110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:00.805588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 240/479] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:00.810909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.820502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76b5bc-c0af-43aa-908a-9b77128d3d6c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.824457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70325dc6-eda8-4184-9e43-7da2a5a290b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.825020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70325dc6-eda8-4184-9e43-7da2a5a290b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.825308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70325dc6-eda8-4184-9e43-7da2a5a290b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.825590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70325dc6-eda8-4184-9e43-7da2a5a290b6 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.826251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70325dc6-eda8-4184-9e43-7da2a5a290b6 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:00.826551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70325dc6-eda8-4184-9e43-7da2a5a290b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.828131 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70325dc6-eda8-4184-9e43-7da2a5a290b6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:00.833065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 240/480] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:28:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:00.838141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:00.847711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeabca-a149-42b6-a23d-f73b9e543057 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:00.851805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af214df6-a94a-4849-9385-c96658053e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:00.852394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af214df6-a94a-4849-9385-c96658053e45 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:00.852687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af214df6-a94a-4849-9385-c96658053e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:00.852977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af214df6-a94a-4849-9385-c96658053e45 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:00.853666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af214df6-a94a-4849-9385-c96658053e45 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:00.854629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-af214df6-a94a-4849-9385-c96658053e45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:28:00.854629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:28:00.854629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:28:00.855480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af214df6-a94a-4849-9385-c96658053e45 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:00.874449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 241/481] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:28:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:28:03.013825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f37cd-fdba-48f2-a128-0cad8adaf632 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.014376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f37cd-fdba-48f2-a128-0cad8adaf632 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.014376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f37cd-fdba-48f2-a128-0cad8adaf632 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.016083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 241/482] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:03.021665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3961-2188-45d2-a7cd-8cd2bd21da60 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.022077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3961-2188-45d2-a7cd-8cd2bd21da60 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.022242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3961-2188-45d2-a7cd-8cd2bd21da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.044278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-651e3961-2188-45d2-a7cd-8cd2bd21da60 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:03.045411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-651e3961-2188-45d2-a7cd-8cd2bd21da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:03.061858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 242/483] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:03 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:03.085636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f37cd-fdba-48f2-a128-0cad8adaf632 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.097338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f37cd-fdba-48f2-a128-0cad8adaf632 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.101329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.102049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.102340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.102625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.115413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:03.122237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:28:03.123299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 242/484] 10.222.0.23 () {56 vars in 1141 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:03.129682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e3961-2188-45d2-a7cd-8cd2bd21da60 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.138150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e3961-2188-45d2-a7cd-8cd2bd21da60 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.142226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.142809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.143103 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.143420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.144852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:03.145165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.146761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.154855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 243/485] 10.222.0.23 () {56 vars in 1136 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:03.160055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.169198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e24998-895c-4f22-827d-f3cba5c97aaf admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.173335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.174032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.174327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.174613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.186326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.188169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.205033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:03.206630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 243/486] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:03.212374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.221358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078e9cd-d019-48a3-95d2-19bebea63fd1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.225455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.226026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.226316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.226601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.227282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:03.227582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.229169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.242338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 244/487] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:03.247414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.257043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36a6b4-f678-4082-b3b7-7d4ea44739df admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.261067 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.261763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.262053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.262339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.275402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.277384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.294456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:28:03.295504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 244/488] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:03.300832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.310032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f2501-ccfa-47f2-9500-dacd6f84b7b5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.314074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.314651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.314937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.315215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.316577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:03.316874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.318651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.349222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 245/489] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:03.354825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.364299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106bbc33-904e-4fb3-a17b-0976c73345c1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.368567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.369135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.369425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.369709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.377309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.379551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.388347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 245/490] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:03.394231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.403660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd503ec-d05c-4ff9-a587-ce32b49a434c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.407750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.408490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.408783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.409107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.420403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.422209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.439245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:03.441222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 246/491] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:03.446475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.454858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc588ac5-50f1-46dd-831b-eeec477346d0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.459063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.459725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.460055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.460343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.461024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:03.461325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.462875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.474699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 246/492] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:03.479863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.489433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b91f8-d1e6-44d9-9f16-801a565912a2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.493562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.494261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.494548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.494829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.503578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.505606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.518735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:03.519755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 247/493] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:03.525125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.534385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4444f-ba67-48ed-8693-d2c7fabf6e02 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.538370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a7a0f-b8e4-46a3-927f-75542eb8d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.538946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7a0f-b8e4-46a3-927f-75542eb8d4ab admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.539244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7a0f-b8e4-46a3-927f-75542eb8d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.539532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7a0f-b8e4-46a3-927f-75542eb8d4ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.540310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7a0f-b8e4-46a3-927f-75542eb8d4ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:03.540619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7a0f-b8e4-46a3-927f-75542eb8d4ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.542424 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7a0f-b8e4-46a3-927f-75542eb8d4ab admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.555526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 247/494] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:03.560811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:03.570525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee8a5-90ea-498b-8d3e-fcced707f535 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:03.574471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b971-3ae7-4f5e-82cf-a67389c54db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:03.575027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b971-3ae7-4f5e-82cf-a67389c54db2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:03.575315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b971-3ae7-4f5e-82cf-a67389c54db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:03.575596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b971-3ae7-4f5e-82cf-a67389c54db2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:03.576405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b971-3ae7-4f5e-82cf-a67389c54db2 admin admin] RBAC: Adding query filter params (role.id=7077d8abcbbd4c0d82bc6377fb9eec8b, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=f724e05a70194ed992e73c9ca77eaef3) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:03.576708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b971-3ae7-4f5e-82cf-a67389c54db2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:03.578482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b971-3ae7-4f5e-82cf-a67389c54db2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:03.583753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 248/495] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:03 2022] GET /identity/v3/role_assignments?user.id=f724e05a70194ed992e73c9ca77eaef3&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=7077d8abcbbd4c0d82bc6377fb9eec8b => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:05.710767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aa07d-f9d3-4551-a723-4f7051e09c43 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.711316 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aa07d-f9d3-4551-a723-4f7051e09c43 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.711414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09aa07d-f9d3-4551-a723-4f7051e09c43 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.713094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 248/496] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:05.718413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746aac-2bd4-4633-a975-946c42204562 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.718839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746aac-2bd4-4633-a975-946c42204562 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.718987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746aac-2bd4-4633-a975-946c42204562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.741408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-ac746aac-2bd4-4633-a975-946c42204562 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:05.742475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ac746aac-2bd4-4633-a975-946c42204562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:05.749210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 249/497] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:05 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:05.771664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09aa07d-f9d3-4551-a723-4f7051e09c43 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:05.783189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09aa07d-f9d3-4551-a723-4f7051e09c43 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:05.787722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:05.788474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.788769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.789055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.800699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:05.807760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:28:05.808861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 249/498] 10.222.0.23 () {56 vars in 1141 bytes} [Fri Apr 8 02:28:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:05.814383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746aac-2bd4-4633-a975-946c42204562 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:05.823657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746aac-2bd4-4633-a975-946c42204562 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:05.827732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:05.828352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.828644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.828931 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.829644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:05.829947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:05.831654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:05.839771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 250/499] 10.222.0.23 () {56 vars in 1136 bytes} [Fri Apr 8 02:28:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:05.844922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:05.855080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72528-3e3a-4fe1-974f-5680cca543ed admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:05.859084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:05.859791 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.860123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.860410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.872329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:05.874130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:05.891978 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:05.893026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 250/500] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:05.899173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:05.908308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d7ad-f101-4d34-86c9-ae1d140c2b20 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:05.912391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:05.912971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.913266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.913552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.914240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:05.914541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:05.916130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:05.928908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 251/501] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:05.933876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:05.943743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3732e-515c-4a8f-b4cc-07ac38247aaf admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:05.947758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:05.948473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:05.948761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:05.949044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:05.961752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:05.963713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:05.980909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:28:05.981935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 251/502] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:28:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:05.987690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:05.996785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fab088-64a6-440b-b0af-be061e1483ba admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:06.000764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:06.001340 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:06.001630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:06.001913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:06.002693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:06.003060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:06.004885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:06.032242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 252/503] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:28:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:06.037874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:06.046834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8f008-a9aa-4034-ac02-59aea3ae6d3d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:06.051555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:06.052538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:06.052832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:06.053114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:06.064556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:06.066543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:06.083081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:06.084132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 252/504] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:06.089171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:06.098726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ed8ae-6fe1-4a21-bfb9-4e4640b5f57a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:06.102785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:06.103359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:06.103651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:06.103955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:06.104651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:06.104954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:06.106524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:06.118305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 253/505] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:06.123215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:06.132649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18588346-98f6-4e3e-9f05-531b7f9a4347 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:06.136690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:06.137367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:06.137653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:06.137930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:06.146173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:06.148111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:06.162133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:06.163151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 253/506] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:06.168328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:06.177857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e2983-4c2b-4562-94db-2958ad126c47 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:06.181957 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7d160-ccd4-46ce-aa17-034d5a490f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:06.182524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d160-ccd4-46ce-aa17-034d5a490f0f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:06.182816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d160-ccd4-46ce-aa17-034d5a490f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:06.183104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7d160-ccd4-46ce-aa17-034d5a490f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:06.183838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7d160-ccd4-46ce-aa17-034d5a490f0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:06.184177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7d160-ccd4-46ce-aa17-034d5a490f0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:06.185971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7d160-ccd4-46ce-aa17-034d5a490f0f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:06.198868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 254/507] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:06.204242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:06.213902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897c47a-7030-457c-be4b-466be9c6429e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:06.218028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a1f7b-7dc3-4f69-8377-8ee32727d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:06.218815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1f7b-7dc3-4f69-8377-8ee32727d81a admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:06.219106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1f7b-7dc3-4f69-8377-8ee32727d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:06.219392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1f7b-7dc3-4f69-8377-8ee32727d81a admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/f724e05a70194ed992e73c9ca77eaef3/roles/7077d8abcbbd4c0d82bc6377fb9eec8b` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:06.221448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a1f7b-7dc3-4f69-8377-8ee32727d81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=f724e05a70194ed992e73c9ca77eaef3, role_id=7077d8abcbbd4c0d82bc6377fb9eec8b)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:06.224064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a1f7b-7dc3-4f69-8377-8ee32727d81a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:06.236081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 254/508] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:28:06 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/f724e05a70194ed992e73c9ca77eaef3/roles/7077d8abcbbd4c0d82bc6377fb9eec8b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:28:08.317682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905dc0-5d73-495f-9ec2-9fb6033d2abc None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.318232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905dc0-5d73-495f-9ec2-9fb6033d2abc None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.318232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905dc0-5d73-495f-9ec2-9fb6033d2abc None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.319938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 255/509] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:08.325104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844dd9-d7da-4d66-85b8-01ed98411971 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.325475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844dd9-d7da-4d66-85b8-01ed98411971 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.325687 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844dd9-d7da-4d66-85b8-01ed98411971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.348065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-47844dd9-d7da-4d66-85b8-01ed98411971 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:08.349207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-47844dd9-d7da-4d66-85b8-01ed98411971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:08.412663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 255/510] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:08 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:08.435538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905dc0-5d73-495f-9ec2-9fb6033d2abc None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.449151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905dc0-5d73-495f-9ec2-9fb6033d2abc None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.453142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.453934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.454285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.454630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.466639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:08.473695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:28:08.474798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 256/511] 10.222.0.23 () {56 vars in 1141 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:08.482900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844dd9-d7da-4d66-85b8-01ed98411971 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.492005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844dd9-d7da-4d66-85b8-01ed98411971 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.496109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.496704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.496997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.497283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.498001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:08.498302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.499897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.508860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 256/512] 10.222.0.23 () {56 vars in 1136 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:08.514505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.524884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d4a1-a229-417d-b19d-78d638a7c217 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.528954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.529657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.529949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.530234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.541169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.542994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.560301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:08.561405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 257/513] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:08.567514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.576717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcfa5e-729e-466d-9b3a-df41b5a7790f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.581468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.582048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.582339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.582627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.583313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:08.583616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.585209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.597214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 257/514] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:08.602304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.611375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69dfd-f185-49de-8adb-c56ae5219ae2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.615551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.616269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.616558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.616841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.630856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.632867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.650277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 08 02:28:08.651300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 258/515] 10.222.0.23 () {56 vars in 1114 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:08.656555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.666040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373050a8-4b28-418f-8e3a-bf4ec9201139 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.670257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.670839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.671127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.671411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.672225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:08.672529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.674330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.702988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 258/516] 10.222.0.23 () {56 vars in 1154 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:08.708723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.717946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f398268-cadf-4cf0-b4a2-eadecde79613 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.722501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.723062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.723350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.723630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.731145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.732891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.743995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 259/517] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:08.749626 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.759543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d750d2-782a-420c-b7e4-8118b97345f7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.763679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.764435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.764733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.765028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.776434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.778248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.794600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:08.795646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 259/518] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:08.801844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.810392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bac926-d7ff-4c4e-8935-b799a87f4961 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.814426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.814993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.816336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.816624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.817304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:08.817605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.819165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.832581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 260/519] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:08.841275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.850980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aa875-cdfa-4cc4-b099-973dd2dbd727 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.856725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.857106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.857393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.857677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.866940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.868935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.882855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:08.883978 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 260/520] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:08.889782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.899812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d894d-85af-4741-9ee6-5503dc324efb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.903898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bcc28-37cb-4b00-bf76-7840bc87a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.904512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcc28-37cb-4b00-bf76-7840bc87a1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.904798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcc28-37cb-4b00-bf76-7840bc87a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.905076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcc28-37cb-4b00-bf76-7840bc87a1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.905812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bcc28-37cb-4b00-bf76-7840bc87a1f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:08.906110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bcc28-37cb-4b00-bf76-7840bc87a1f2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.907913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bcc28-37cb-4b00-bf76-7840bc87a1f2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.920728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 261/521] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:08.927045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:08.936451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b20843-8318-4130-b11f-6d111525c397 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:08.942097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33affa6c-2ab7-4820-8199-975e7ceea1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:08.942749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affa6c-2ab7-4820-8199-975e7ceea1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:08.943042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affa6c-2ab7-4820-8199-975e7ceea1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:08.943326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affa6c-2ab7-4820-8199-975e7ceea1e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:08.944145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affa6c-2ab7-4820-8199-975e7ceea1e6 admin admin] RBAC: Adding query filter params (role.id=7077d8abcbbd4c0d82bc6377fb9eec8b, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=f724e05a70194ed992e73c9ca77eaef3) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:08.944454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affa6c-2ab7-4820-8199-975e7ceea1e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:08.946268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affa6c-2ab7-4820-8199-975e7ceea1e6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:08.951737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 261/522] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:08 2022] GET /identity/v3/role_assignments?user.id=f724e05a70194ed992e73c9ca77eaef3&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=7077d8abcbbd4c0d82bc6377fb9eec8b => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:11.208517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03faa0-9791-4bde-aaed-2774773288f1 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.209044 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03faa0-9791-4bde-aaed-2774773288f1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.209162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03faa0-9791-4bde-aaed-2774773288f1 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.210740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 262/523] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:11.215990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651274f8-9098-4e67-a264-3ffe16e71ae0 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.216400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651274f8-9098-4e67-a264-3ffe16e71ae0 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.216574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651274f8-9098-4e67-a264-3ffe16e71ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.238996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-651274f8-9098-4e67-a264-3ffe16e71ae0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:11.240184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-651274f8-9098-4e67-a264-3ffe16e71ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:11.246887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 262/524] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:11 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:11.271212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03faa0-9791-4bde-aaed-2774773288f1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:11.282607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03faa0-9791-4bde-aaed-2774773288f1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:11.286642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:11.287344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.287629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.287907 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.299069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:11.301098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:11.318085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:11.319130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 263/525] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:11.324874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651274f8-9098-4e67-a264-3ffe16e71ae0 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:11.333945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651274f8-9098-4e67-a264-3ffe16e71ae0 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:11.338035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6433-7079-4791-92c1-257b56eca4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:11.338615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6433-7079-4791-92c1-257b56eca4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.338908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6433-7079-4791-92c1-257b56eca4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.339195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6433-7079-4791-92c1-257b56eca4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.339887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6433-7079-4791-92c1-257b56eca4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:11.340220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6433-7079-4791-92c1-257b56eca4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:11.341789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6433-7079-4791-92c1-257b56eca4a4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:11.353839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 263/526] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:11.358827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:11.368103 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0ce8e-e950-4649-b24b-1daace33fe84 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:11.372107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe2a34-8ce0-42c0-9b49-5ff9a1d1ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:11.372675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2a34-8ce0-42c0-9b49-5ff9a1d1ad4e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:11.372964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2a34-8ce0-42c0-9b49-5ff9a1d1ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:11.373253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe2a34-8ce0-42c0-9b49-5ff9a1d1ad4e admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:11.373888 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe2a34-8ce0-42c0-9b49-5ff9a1d1ad4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:11.375721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe2a34-8ce0-42c0-9b49-5ff9a1d1ad4e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:11.395268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 264/527] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:28:11 2022] POST /identity/v3/users => generated 248 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:28:13.512438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f876-e57d-4705-ad38-5a9a1b259aaf None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.512934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f876-e57d-4705-ad38-5a9a1b259aaf None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.513050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f876-e57d-4705-ad38-5a9a1b259aaf None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.514670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 264/528] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:13.520006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea220d3-b8e0-4c6d-b169-bf740800c016 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.520422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea220d3-b8e0-4c6d-b169-bf740800c016 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.520595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea220d3-b8e0-4c6d-b169-bf740800c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.542677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9ea220d3-b8e0-4c6d-b169-bf740800c016 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:13.543829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9ea220d3-b8e0-4c6d-b169-bf740800c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:13.551266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 265/529] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:13 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:13.573941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f876-e57d-4705-ad38-5a9a1b259aaf None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.585744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f876-e57d-4705-ad38-5a9a1b259aaf None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.589703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.590408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.590701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.590983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.602274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:13.608666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:13.609727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 265/530] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:13.615848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea220d3-b8e0-4c6d-b169-bf740800c016 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.625964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea220d3-b8e0-4c6d-b169-bf740800c016 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.630145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.630732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.631025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.631314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.632079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:13.632388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.633961 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.642142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 266/531] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:13.647527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.657039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192413a-c7aa-4c30-a0c6-665c503ed2a1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.661876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.662573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.662866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.663153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.674061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.676541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.693629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:13.694669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 266/532] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:13.699766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.709017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646a4cc-e049-47bc-8949-1f62215d9659 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.713123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.713698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.713989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.714273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.714949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:13.715248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.716824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.729431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 267/533] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:13.734573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.744493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e54a2b-088a-41f9-817b-56bcd0445615 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.748557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.749247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.749539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.749826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.762082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.764103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.781275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 08 02:28:13.782308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 267/534] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:13.788065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.797055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49154ce9-10af-45eb-a484-9b4ce8ae1d79 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.802133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.802977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.803268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.803552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.804367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:13.804669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.806461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.833769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 268/535] 10.222.0.23 () {56 vars in 1158 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:13.838894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.849907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690e7d3-e44b-4c3c-ac85-ebeb149a8212 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.854923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.855485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.855776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.856099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.864935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.866699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.875036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 268/536] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:13.880661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.889804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c614b2-0d50-419b-b469-ca9ca64760fb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.894533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.895232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.895521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.895806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.906984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.909548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.926048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:13.927074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 269/537] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:13.932658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.942118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3fb5cc-cca3-44f9-9890-cb98f059554b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.946291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.946870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.947163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.947451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.948184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:13.948490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.950048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:13.962813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 269/538] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:13.968007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:13.978289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2629-9e07-4295-8d5a-d2cca4fdb0f2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:13.982329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:13.983027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:13.983318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:13.983597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:13.992416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:13.994302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:14.007901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:14.008955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 270/539] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:14.014434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:14.024233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972ab75-7b55-42a6-8405-e041e05d2ba9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:14.028312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2762a7-f7f7-4dd0-8bb0-115a51e9c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:14.028887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2762a7-f7f7-4dd0-8bb0-115a51e9c615 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:14.029178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2762a7-f7f7-4dd0-8bb0-115a51e9c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:14.029464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2762a7-f7f7-4dd0-8bb0-115a51e9c615 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:14.030206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2762a7-f7f7-4dd0-8bb0-115a51e9c615 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:14.030509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2762a7-f7f7-4dd0-8bb0-115a51e9c615 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:14.032415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2762a7-f7f7-4dd0-8bb0-115a51e9c615 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:14.046632 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 270/540] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:14.052899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:14.061972 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04747da0-5f4e-47c7-a8d8-4d8ee86667e3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:14.066072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02490ddf-b550-45cf-8e09-fe922d3b1c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:14.066633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490ddf-b550-45cf-8e09-fe922d3b1c7c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:14.066923 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490ddf-b550-45cf-8e09-fe922d3b1c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:14.067204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02490ddf-b550-45cf-8e09-fe922d3b1c7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:14.068017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02490ddf-b550-45cf-8e09-fe922d3b1c7c admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=9fbc37924fca422ea9b4865259c740f7) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:14.068323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02490ddf-b550-45cf-8e09-fe922d3b1c7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:14.070128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02490ddf-b550-45cf-8e09-fe922d3b1c7c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:14.075316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 271/541] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:14 2022] GET /identity/v3/role_assignments?user.id=9fbc37924fca422ea9b4865259c740f7&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.170622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cd72-0821-4f5b-8300-ceff7f0c5b6c None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.171177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cd72-0821-4f5b-8300-ceff7f0c5b6c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.171177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0cd72-0821-4f5b-8300-ceff7f0c5b6c None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.172874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 271/542] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:16.178747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ebbd-1196-4e36-be80-9dcb5538d45c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.179118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ebbd-1196-4e36-be80-9dcb5538d45c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.179331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4ebbd-1196-4e36-be80-9dcb5538d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.201617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-dcf4ebbd-1196-4e36-be80-9dcb5538d45c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:16.202758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-dcf4ebbd-1196-4e36-be80-9dcb5538d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:16.209744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 272/543] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:16 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:16.231870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0cd72-0821-4f5b-8300-ceff7f0c5b6c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.243950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0cd72-0821-4f5b-8300-ceff7f0c5b6c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.247904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.248648 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.248938 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.249226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.260710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:16.267069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:16.268194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 272/544] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:16.273623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4ebbd-1196-4e36-be80-9dcb5538d45c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.282070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4ebbd-1196-4e36-be80-9dcb5538d45c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.286311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.286890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.287182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.287467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.288224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:16.288529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.290125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.298229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 273/545] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.304237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.313600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12b00e-4611-47c9-9146-6b3b11cf20c8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.318279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.318964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.319253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.319534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.330350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.332272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.348938 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:16.349967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 273/546] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:16.355144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.365239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa0d1e-b6f7-4fa2-9fe2-b4c6f9cacbca admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.369260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.369826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.370115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.370395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.371076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:16.371443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.373004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.387344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 274/547] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.392602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.401869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b43a5c-f6bb-4c04-8aa9-18fa8c55af08 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.406009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.406718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.407009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.407295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.419715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.421775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.439677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 08 02:28:16.440950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:16.446286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.456031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cfd33-2f1a-4c8c-ac27-6243f5181ec1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.460207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.460794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.461085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.461372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.462159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:16.462464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.464331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.492744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 275/549] 10.222.0.23 () {56 vars in 1158 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.498569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.508589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85d759-4c42-4224-829d-04e7af30c7b8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.512614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.513313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.513601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.513882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.525911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.527700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.544336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:16.545373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 275/550] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:16.550747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.560027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490674c-fb9c-45ec-95b8-fdbec8c9139f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.564140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.565237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.565526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.565808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.566485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:16.566799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.568383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.579959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 276/551] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.585674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.594812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab887b95-fea4-4c37-9a6f-5653a174198c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.599398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.600125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.600474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.600763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.608962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.610870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.624210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:16.625247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 276/552] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:16.631492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.640455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e8b40-6a23-4b1c-84d5-9d9cfcd56ac1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.645675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb4e20-b8b8-421d-bc0b-c235a3a6df6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.646240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4e20-b8b8-421d-bc0b-c235a3a6df6d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.646527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4e20-b8b8-421d-bc0b-c235a3a6df6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.646808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4e20-b8b8-421d-bc0b-c235a3a6df6d admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.647540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb4e20-b8b8-421d-bc0b-c235a3a6df6d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:16.647837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb4e20-b8b8-421d-bc0b-c235a3a6df6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.649646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb4e20-b8b8-421d-bc0b-c235a3a6df6d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.662273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 277/553] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:16.667627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:16.676773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03775b96-10c3-4f42-b9bd-941469db4c1b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:16.681027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273c1bc-d6ce-44d7-a3be-43e47d05a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:16.681813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c1bc-d6ce-44d7-a3be-43e47d05a0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:16.682102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c1bc-d6ce-44d7-a3be-43e47d05a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:16.682386 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273c1bc-d6ce-44d7-a3be-43e47d05a0e5 admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/9fbc37924fca422ea9b4865259c740f7/roles/58f38def815542948bd51acfd4644ea3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:16.701705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273c1bc-d6ce-44d7-a3be-43e47d05a0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=9fbc37924fca422ea9b4865259c740f7, role_id=58f38def815542948bd51acfd4644ea3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:16.704348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273c1bc-d6ce-44d7-a3be-43e47d05a0e5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:16.716802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 277/554] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:28:16 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/9fbc37924fca422ea9b4865259c740f7/roles/58f38def815542948bd51acfd4644ea3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:28:18.788997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f276-b82f-40ed-b8bc-c190e9a0577c None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.789490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f276-b82f-40ed-b8bc-c190e9a0577c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.789490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287f276-b82f-40ed-b8bc-c190e9a0577c None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.791146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 278/555] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:18.796402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a656d03-a79e-48ea-a11f-e66948404258 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.796766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a656d03-a79e-48ea-a11f-e66948404258 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.796983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a656d03-a79e-48ea-a11f-e66948404258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.819721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4a656d03-a79e-48ea-a11f-e66948404258 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:18.820917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4a656d03-a79e-48ea-a11f-e66948404258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:18.884770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 278/556] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:18 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:18.912612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f276-b82f-40ed-b8bc-c190e9a0577c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.924878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287f276-b82f-40ed-b8bc-c190e9a0577c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.929151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.929860 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.930155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.930443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.941393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:18.947758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:18.948858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 279/557] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:18.954564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a656d03-a79e-48ea-a11f-e66948404258 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.964112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a656d03-a79e-48ea-a11f-e66948404258 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:18.968245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:18.968833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:18.969127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:18.969416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:18.970133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:18.970438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:18.972738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:18.980869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 279/558] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:18.986077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:18.996279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72c292-b53e-4ae5-87a0-88e038c32512 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.000425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.001114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.001406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.001690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.013031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.014831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.031806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:19.032855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 280/559] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:19.038778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.047803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca4684-474c-4149-b257-2349cabc66ec admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.052964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.053543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.053836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.054119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.054807 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:19.055110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.056723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.068904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 280/560] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:19.074289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.083568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276426-cf66-4722-8a53-39e489673b54 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.087679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.088419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.088714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.089001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.101813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.103795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.121593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 08 02:28:19.122626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 281/561] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:19.127906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.136937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d8100-c6c7-4064-bfa8-afd4e7eb6b44 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.141042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.141619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.141909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.142193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.143563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:19.143865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.145676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.176609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 281/562] 10.222.0.23 () {56 vars in 1158 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:19.182751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.192232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb327f7-eda5-4bbd-a520-826411f6d31c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.196343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.196908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.197197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.197482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.205025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.207388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.215684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 282/563] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:28:19.221989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.231601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0521b59-0c6d-470a-82ed-d459b9ddd50a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.235723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.236624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.236882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.237212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.248375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.250186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.266558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:19.267586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 282/564] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:19.273552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.281964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a803-e027-4b70-b1b6-0b47250f258d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.286709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.287284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.287576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.287862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.288588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:19.288893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.290459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.303274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 283/565] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:19.308279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.317337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae413c60-b308-4621-89b8-48bcde8e1327 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.321349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.322040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.322326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.322607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.331211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.333130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.347017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:19.348054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 283/566] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:19.353282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.362522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2577900-80b1-4957-babf-330ab03835a5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.366599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff242c-68a6-44f1-9a86-898ae1cd7916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.367165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff242c-68a6-44f1-9a86-898ae1cd7916 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.367453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff242c-68a6-44f1-9a86-898ae1cd7916 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.367734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff242c-68a6-44f1-9a86-898ae1cd7916 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.368506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff242c-68a6-44f1-9a86-898ae1cd7916 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:19.368804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff242c-68a6-44f1-9a86-898ae1cd7916 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.370589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff242c-68a6-44f1-9a86-898ae1cd7916 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.383127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 284/567] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:19.388638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:19.398380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9cf4-e5ec-4744-9c5f-f733ec026b95 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:19.402469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ea4a6-bac1-419b-8140-7af78925160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:19.403029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ea4a6-bac1-419b-8140-7af78925160c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:19.403314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ea4a6-bac1-419b-8140-7af78925160c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:19.403598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ea4a6-bac1-419b-8140-7af78925160c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:19.404407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ea4a6-bac1-419b-8140-7af78925160c admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=9fbc37924fca422ea9b4865259c740f7) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:19.404713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ea4a6-bac1-419b-8140-7af78925160c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:19.406497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ea4a6-bac1-419b-8140-7af78925160c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:19.412661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 284/568] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:19 2022] GET /identity/v3/role_assignments?user.id=9fbc37924fca422ea9b4865259c740f7&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:21.593263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1527-5866-4474-a167-a2b45c312f4a None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.593775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1527-5866-4474-a167-a2b45c312f4a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.593883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1527-5866-4474-a167-a2b45c312f4a None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.595508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 285/569] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:21.601263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf1d5-35e3-48e5-94d8-da838cbf65b6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.601679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf1d5-35e3-48e5-94d8-da838cbf65b6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.601849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf1d5-35e3-48e5-94d8-da838cbf65b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.623670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-79dcf1d5-35e3-48e5-94d8-da838cbf65b6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:21.624856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-79dcf1d5-35e3-48e5-94d8-da838cbf65b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:21.631609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 285/570] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:21 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:21.655475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad1527-5866-4474-a167-a2b45c312f4a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:21.667739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad1527-5866-4474-a167-a2b45c312f4a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:21.671691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:21.672435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.672729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.673080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.684815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:21.686628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:21.703200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:21.704268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 286/571] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:21.710504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf1d5-35e3-48e5-94d8-da838cbf65b6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:21.718925 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf1d5-35e3-48e5-94d8-da838cbf65b6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:21.723619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3448b6-61a8-4cb3-9be6-b753e830aa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:21.724234 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3448b6-61a8-4cb3-9be6-b753e830aa0b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.724525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3448b6-61a8-4cb3-9be6-b753e830aa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.724808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3448b6-61a8-4cb3-9be6-b753e830aa0b admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.725499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3448b6-61a8-4cb3-9be6-b753e830aa0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:21.725801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3448b6-61a8-4cb3-9be6-b753e830aa0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:21.727352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3448b6-61a8-4cb3-9be6-b753e830aa0b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:21.739413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 286/572] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:21.744511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:21.754059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2bffa-2e7e-4c8c-89e8-d2d7d03a7d44 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:21.758144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b1b64-a359-4012-8ae7-4680207c011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:21.758725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1b64-a359-4012-8ae7-4680207c011e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:21.759015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1b64-a359-4012-8ae7-4680207c011e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:21.759299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1b64-a359-4012-8ae7-4680207c011e admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:21.759986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b1b64-a359-4012-8ae7-4680207c011e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:21.761854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b1b64-a359-4012-8ae7-4680207c011e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:21.781653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 287/573] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:28:21 2022] POST /identity/v3/users => generated 254 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:28:23.890191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a37f6-dfb5-4151-b6d1-96b3b969ca42 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.890720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a37f6-dfb5-4151-b6d1-96b3b969ca42 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.890832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a37f6-dfb5-4151-b6d1-96b3b969ca42 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.892472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 287/574] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:23.897827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70bc95-6185-44fa-b2e8-6a9fbee9ae36 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.898241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70bc95-6185-44fa-b2e8-6a9fbee9ae36 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.898398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70bc95-6185-44fa-b2e8-6a9fbee9ae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.920130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5a70bc95-6185-44fa-b2e8-6a9fbee9ae36 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:23.921282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5a70bc95-6185-44fa-b2e8-6a9fbee9ae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:23.928943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 288/575] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:23 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:23.952768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a37f6-dfb5-4151-b6d1-96b3b969ca42 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:23.964563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a37f6-dfb5-4151-b6d1-96b3b969ca42 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:23.968539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:23.969246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:23.969542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:23.969832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:23.980820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:23.988028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:23.989099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 288/576] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:23.994735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70bc95-6185-44fa-b2e8-6a9fbee9ae36 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.004438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70bc95-6185-44fa-b2e8-6a9fbee9ae36 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.008478 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.009058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.009346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.009628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.010337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:24.010636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.012241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.020740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 289/577] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:24.025806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.035866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590229-6b9c-4200-9b7c-47e23edb1ec0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.040028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.040711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.040999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.041279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.052950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.054744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.071413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:24.072496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 289/578] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:24.077919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.087065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64b4e7-d5b8-4fd3-be60-44a759eae74e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.091141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.091717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.092048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.092337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.093021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:24.093326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.094878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.108626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 290/579] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:24.114275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.123403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9da3e8-8fd1-4c3f-abf8-77b47869390e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.127745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.128520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.128812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.129096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.141783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.143913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.162161 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:28:24.163217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 290/580] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:24.168664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.178872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42794a4e-5353-4998-93a6-54a95787b1bf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.182936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.183523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.183811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.184127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.184910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:24.185212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.187014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.214601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 291/581] 10.222.0.23 () {56 vars in 1170 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:24.223454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.234611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a4cf0-e2ca-46a5-b418-39ad5fc51d8d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.240229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.240809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.241104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.241395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.250976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.252782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.261158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 291/582] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:24.266857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.276084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0baa98-20b4-49c7-be99-2b2a699354c8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.280259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.280968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.281258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.281543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.293420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.295216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.312409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:24.313441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 292/583] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:24.318826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.327208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961ba01-90f4-4b73-ab7b-9af6e84c07ae admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.331447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.332091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.332386 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.332678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.333364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:24.333671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.335222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.347951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 292/584] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:24.352993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.363094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a795ac-37b0-42d7-bbce-a88e5adc5a2a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.367197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.367889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.368206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.368488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.376904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.379231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.393062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:24.394433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 293/585] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:24.399813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.409737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a7f8-8aab-4bc2-9d31-78d32c06d972 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.413843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02a651-cf17-4a6e-9ee9-11d3db03ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.414412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02a651-cf17-4a6e-9ee9-11d3db03ad4c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.414704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02a651-cf17-4a6e-9ee9-11d3db03ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.414989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02a651-cf17-4a6e-9ee9-11d3db03ad4c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.415723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02a651-cf17-4a6e-9ee9-11d3db03ad4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:24.416059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02a651-cf17-4a6e-9ee9-11d3db03ad4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.417858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02a651-cf17-4a6e-9ee9-11d3db03ad4c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.430474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 293/586] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:24.435844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:24.445382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af6c78-733d-47ae-9edc-a9d978ecce8b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:24.449441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5af87-e771-43d0-b3dd-7a5cbf16ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:24.450004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5af87-e771-43d0-b3dd-7a5cbf16ae61 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:24.450292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5af87-e771-43d0-b3dd-7a5cbf16ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:24.450573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5af87-e771-43d0-b3dd-7a5cbf16ae61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:24.451346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5af87-e771-43d0-b3dd-7a5cbf16ae61 admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=51a85bd55f4749aa9aa37a834229f06b) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:24.451650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5af87-e771-43d0-b3dd-7a5cbf16ae61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:24.453470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5af87-e771-43d0-b3dd-7a5cbf16ae61 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:24.459549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 294/587] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:24 2022] GET /identity/v3/role_assignments?user.id=51a85bd55f4749aa9aa37a834229f06b&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:26.535231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b31e0-693b-4221-934f-404945e2109f None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.535748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b31e0-693b-4221-934f-404945e2109f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.535859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b31e0-693b-4221-934f-404945e2109f None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.537586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 294/588] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:26.542774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841eb0-afc5-408d-826e-fbc3a763b779 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.543216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841eb0-afc5-408d-826e-fbc3a763b779 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.543339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5841eb0-afc5-408d-826e-fbc3a763b779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.566455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f5841eb0-afc5-408d-826e-fbc3a763b779 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:26.567591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f5841eb0-afc5-408d-826e-fbc3a763b779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:26.574338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 295/589] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:26 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:26.597222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b31e0-693b-4221-934f-404945e2109f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.608832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b31e0-693b-4221-934f-404945e2109f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.612923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.613631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.613926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.614216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.625137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:26.632083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:26.633153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 295/590] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:26.638529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841eb0-afc5-408d-826e-fbc3a763b779 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.647557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5841eb0-afc5-408d-826e-fbc3a763b779 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.651637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.652259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.652547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.652827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.653537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:26.653836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.655396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.663826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 296/591] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:26.668909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.679174 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca6474-62ec-44c6-82a5-99075c285535 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.683308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.684041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.684340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.684629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.696628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.698437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.715233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:26.716311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 296/592] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:26.721463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.730474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a626b-5760-4084-a5a4-d2682796c6fe admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.734596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.735116 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.735407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.735691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.736913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:26.737219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.738836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.750748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 297/593] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:26.756244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.765287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ca952-873d-460b-9a66-017f15a26bc9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.769535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.770241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.770536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.770824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.784357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.786331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.805460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:28:26.806521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 297/594] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:26.812091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.822112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab058a-fd5b-450c-8281-f44564ebd5a7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.826177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.826759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.827047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.827324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.828133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:26.828435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.830699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.865407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 298/595] 10.222.0.23 () {56 vars in 1170 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:26.870938 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.880950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724588-d1ab-4581-9c78-b4f4265bbf07 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.885132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.885845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.886141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.886427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.898266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.900124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.916479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:26.917540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 298/596] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:26.923160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.933638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487ce2-1007-465c-87fe-1f1984b87aa2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.937703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.938279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.938569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.938855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.940589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:26.940893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.942451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.953936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 299/597] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:26.959112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:26.968132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a6cd6-10c2-4d5e-b0f8-3eb76628e808 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:26.972286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:26.972980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:26.973270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:26.973553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:26.981727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:26.983616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:26.997363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:26.998329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 299/598] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:27.004241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.013302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79c6f-6dac-4a0e-bf32-536e7cf356b2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:27.017437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62c7d0-d10f-4b22-8554-f193de6c05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:27.018017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62c7d0-d10f-4b22-8554-f193de6c05e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.018302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62c7d0-d10f-4b22-8554-f193de6c05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.018588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62c7d0-d10f-4b22-8554-f193de6c05e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.019325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62c7d0-d10f-4b22-8554-f193de6c05e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:27.019627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62c7d0-d10f-4b22-8554-f193de6c05e0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:27.021467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62c7d0-d10f-4b22-8554-f193de6c05e0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:27.034179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 300/599] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:27.039356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:27.048210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519ceb-ba35-4584-9b96-63a96458ab90 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:27.053649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8dff2-def4-4a64-9737-d7531edeb454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:27.054427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8dff2-def4-4a64-9737-d7531edeb454 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:27.054715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8dff2-def4-4a64-9737-d7531edeb454 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:27.054999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8dff2-def4-4a64-9737-d7531edeb454 admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/51a85bd55f4749aa9aa37a834229f06b/roles/58f38def815542948bd51acfd4644ea3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:27.074173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8dff2-def4-4a64-9737-d7531edeb454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=51a85bd55f4749aa9aa37a834229f06b, role_id=58f38def815542948bd51acfd4644ea3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:27.076787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8dff2-def4-4a64-9737-d7531edeb454 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:27.089170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 300/600] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:28:27 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/51a85bd55f4749aa9aa37a834229f06b/roles/58f38def815542948bd51acfd4644ea3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:29.178679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94741-f159-4cf0-9123-bb15ef8b2082 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.179204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94741-f159-4cf0-9123-bb15ef8b2082 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.179287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac94741-f159-4cf0-9123-bb15ef8b2082 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.180953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 301/601] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:29.186296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eab761-a0c2-4bb5-8229-17e3d0a592dc None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.186709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eab761-a0c2-4bb5-8229-17e3d0a592dc None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.186869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eab761-a0c2-4bb5-8229-17e3d0a592dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.210863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a3eab761-a0c2-4bb5-8229-17e3d0a592dc None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:29.212035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a3eab761-a0c2-4bb5-8229-17e3d0a592dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:29.274557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 301/602] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:29 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:29.298223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94741-f159-4cf0-9123-bb15ef8b2082 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.310574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac94741-f159-4cf0-9123-bb15ef8b2082 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.314496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.315196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.315481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.315761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.326475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:29.332772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:29.333820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 302/603] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:29.339431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eab761-a0c2-4bb5-8229-17e3d0a592dc None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.349864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eab761-a0c2-4bb5-8229-17e3d0a592dc None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.355191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.355792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.356121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.356413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.357141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:29.357452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.359055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.368166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 302/604] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:29.373648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.383338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2355520-b0f1-4753-95c1-2fbd84d67160 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.387420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.388144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.388433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.388714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.399621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.401473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.418628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:29.419656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 303/605] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:29.425561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.434941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc35f4-9f1b-4b70-a483-b891576d2b07 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.438999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.439711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.440035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.440326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.441014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:29.441321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.442879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.454869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 303/606] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:29.460207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.469428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b6260-e638-4b03-a00a-9b559d8a5762 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.474118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.474836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.475124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.475407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.489706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.491685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.509098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:28:29.510143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 304/607] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:29.515697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.525245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4064a-38bf-483c-8a1a-1523bb500863 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.529374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.529959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.530251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.530538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.531353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:29.531659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.533997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.562626 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 304/608] 10.222.0.23 () {56 vars in 1170 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:29.568128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.577311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e0368-9edc-4c53-919a-1d6ac7f20bdc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.581497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.582058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.582348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.582633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.590158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.591884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.600799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 305/609] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:29.605977 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.615553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69d095-544b-46d1-9c8a-69d50a8d2b70 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.619650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.620392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.620687 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.620975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.632160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.633992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.651641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:29.652792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 305/610] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:29.660294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.668878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ad762-bf4f-4df9-b453-5fa199662084 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.673096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.673704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.673997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.674281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.674975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:29.675276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.676878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.689447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 306/611] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:29.694699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.704039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760aa682-d377-4756-93c7-f27bbc458b2f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.708684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.709391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.709684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.709971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.718248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.720220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.734011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:29.735054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 306/612] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:29.740602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.749789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b3b94-ab95-4d08-a3ae-069f07d246b2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.754019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910efaa-b5b9-481a-a0fb-9d8525b7a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.754595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910efaa-b5b9-481a-a0fb-9d8525b7a198 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.754888 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910efaa-b5b9-481a-a0fb-9d8525b7a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.755175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910efaa-b5b9-481a-a0fb-9d8525b7a198 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.755920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910efaa-b5b9-481a-a0fb-9d8525b7a198 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:29.756255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910efaa-b5b9-481a-a0fb-9d8525b7a198 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.758062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910efaa-b5b9-481a-a0fb-9d8525b7a198 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.770830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 307/613] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:29.776354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:29.785995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dd922-5a7c-4191-ab44-b5bde971c12b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:29.790014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18198357-d397-4160-ac3b-786db6aa5a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:29.790575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18198357-d397-4160-ac3b-786db6aa5a61 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:29.790868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18198357-d397-4160-ac3b-786db6aa5a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:29.791154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18198357-d397-4160-ac3b-786db6aa5a61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:29.791946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18198357-d397-4160-ac3b-786db6aa5a61 admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=51a85bd55f4749aa9aa37a834229f06b) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:29.792255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18198357-d397-4160-ac3b-786db6aa5a61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:29.794067 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18198357-d397-4160-ac3b-786db6aa5a61 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:29.799748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 307/614] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:29 2022] GET /identity/v3/role_assignments?user.id=51a85bd55f4749aa9aa37a834229f06b&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:31.966783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dea4d4-b9dd-4171-8951-e0089665c3a0 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:31.967360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dea4d4-b9dd-4171-8951-e0089665c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:31.967360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dea4d4-b9dd-4171-8951-e0089665c3a0 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:31.969050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 308/615] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:31.974903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f1a7-7fdf-4a9c-9b9a-767b593ac9a1 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:31.975328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f1a7-7fdf-4a9c-9b9a-767b593ac9a1 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:31.975483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f1a7-7fdf-4a9c-9b9a-767b593ac9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:31.998677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f617f1a7-7fdf-4a9c-9b9a-767b593ac9a1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:31.999828 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f617f1a7-7fdf-4a9c-9b9a-767b593ac9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:32.006731 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 308/616] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:31 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:32.030113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dea4d4-b9dd-4171-8951-e0089665c3a0 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.042394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dea4d4-b9dd-4171-8951-e0089665c3a0 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.046381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.047101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.047395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.047680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.058960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:32.065827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:28:32.066893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 309/617] 10.222.0.23 () {56 vars in 1141 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:32.072485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f1a7-7fdf-4a9c-9b9a-767b593ac9a1 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.081402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f1a7-7fdf-4a9c-9b9a-767b593ac9a1 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.085523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.086102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.086393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.086675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.087391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:32.087693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.089314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.097989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 309/618] 10.222.0.23 () {56 vars in 1136 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:32.103002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.112636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844eb3-4c02-4b0b-ae93-704700a2cd14 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.116776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.117458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.117752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.118040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.129059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.130861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.148197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:32.149227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 310/619] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:32.154344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.163431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d792df-1f5b-42c5-a80f-245a70b1a349 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.167511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.168114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.168407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.168695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.169376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:32.169679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.171218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.183853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 310/620] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:32.188796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.198473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8e440-6824-47be-bae9-edf3638895d9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.202596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.203299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.203591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.203877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.216197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.218207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.235797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:28:32.237346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 311/621] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:32.242557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.252158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836744a-c06e-4791-b3b7-ffef5b63940c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.256494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.257085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.257376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.257661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.258448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:32.258753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.260599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.289027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 311/622] 10.222.0.23 () {56 vars in 1170 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:32.294424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.304633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b7e92-2089-4e41-82b6-e2854f2f48ba admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.308767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.309331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.309625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.309914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.317577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.319305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.327621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 312/623] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:32.333255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.343085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9744dd7-01df-4716-ae88-22af2604fe7f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.348511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.349226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.349517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.349800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.361864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.363466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.379808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:32.380878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 312/624] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:32.386348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.395050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a8c0-917e-4d22-8c96-95c1d9563eea admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.399204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.399772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.400099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.400387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.401075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:32.401395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.402950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.415877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 313/625] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:32.421142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.431181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f39be1-b3d9-482b-bff4-6f6b1f99b07f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.435225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.435920 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.436232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.436515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.444786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.446706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.459787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:32.460852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 313/626] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:32.466237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.476674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be66e5f-356d-4bdd-aee7-d8517ed0434a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.480676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbea603-9c14-4f23-91df-a50b5e47014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.481250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea603-9c14-4f23-91df-a50b5e47014e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.481538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea603-9c14-4f23-91df-a50b5e47014e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.481821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea603-9c14-4f23-91df-a50b5e47014e admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.482559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea603-9c14-4f23-91df-a50b5e47014e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:32.482858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea603-9c14-4f23-91df-a50b5e47014e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.484696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea603-9c14-4f23-91df-a50b5e47014e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.498046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 314/627] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:32.503953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:32.513165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c26e3-cba5-4d81-a0e1-0801660e34c4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:32.517249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bc8f9-37b5-4ced-b842-d0c8efa857f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:32.517818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc8f9-37b5-4ced-b842-d0c8efa857f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:32.518109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc8f9-37b5-4ced-b842-d0c8efa857f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:32.518395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bc8f9-37b5-4ced-b842-d0c8efa857f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:32.519172 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bc8f9-37b5-4ced-b842-d0c8efa857f7 admin admin] RBAC: Adding query filter params (role.id=7077d8abcbbd4c0d82bc6377fb9eec8b, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=51a85bd55f4749aa9aa37a834229f06b) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:32.519478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bc8f9-37b5-4ced-b842-d0c8efa857f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:32.521315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12bc8f9-37b5-4ced-b842-d0c8efa857f7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:32.526448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 314/628] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:32 2022] GET /identity/v3/role_assignments?user.id=51a85bd55f4749aa9aa37a834229f06b&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=7077d8abcbbd4c0d82bc6377fb9eec8b => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:34.588727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb41a-c848-44b6-a859-33811c3daf37 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.589265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb41a-c848-44b6-a859-33811c3daf37 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.589354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb41a-c848-44b6-a859-33811c3daf37 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.590954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 315/629] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:34.596087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8db1e-1a7a-4c6a-b783-acbac4d9ec85 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.596463 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8db1e-1a7a-4c6a-b783-acbac4d9ec85 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.596675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8db1e-1a7a-4c6a-b783-acbac4d9ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.618623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-67b8db1e-1a7a-4c6a-b783-acbac4d9ec85 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:34.619768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-67b8db1e-1a7a-4c6a-b783-acbac4d9ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:34.627255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 315/630] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:34 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:34.651091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beb41a-c848-44b6-a859-33811c3daf37 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.663008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beb41a-c848-44b6-a859-33811c3daf37 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.668623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.669857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.670381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.670920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.683054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:34.690451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:28:34.691589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 316/631] 10.222.0.23 () {56 vars in 1141 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:34.697455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8db1e-1a7a-4c6a-b783-acbac4d9ec85 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.707129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8db1e-1a7a-4c6a-b783-acbac4d9ec85 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.711220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.711808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.712125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.712411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.713122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:34.713423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.714986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:34.723856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 316/632] 10.222.0.23 () {56 vars in 1136 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:34.728933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.739086 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a163993-a059-4075-8ba7-6773f37d12bd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.743256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.743897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.744215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.744501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.755890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.757739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:34.775202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:34.776280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 317/633] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:34.781637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.791262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a1956-984e-4570-ba88-2a5b1f6df6e3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.795314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.795882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.796202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.796493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.797169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:34.797468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.799538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:34.811666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 317/634] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:34.821478 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.831521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc238f-c6ef-4e09-825c-190334af16a6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.835666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.836424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.836720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.837006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.849456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.851446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:34.869170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:28:34.870220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 318/635] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:34.875639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.885390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9204b8c-62f5-4362-ba8a-cea26429110d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.889509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.890092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.890384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.890669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.891492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:34.891793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.894293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:34.921703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 318/636] 10.222.0.23 () {56 vars in 1170 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:34.927726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.936871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adfaee-ad08-4000-8ace-a7e5c9b5b929 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.941630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.942330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.942622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.942910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.954382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.956415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:34.973036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:34.974070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 319/637] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:34.979255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:34.988834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f277a-0e24-48e8-a230-b2ce72c6efbf admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:34.992935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:34.993559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:34.993808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:34.994096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:34.994804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:34.995082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:34.996676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:35.008391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 319/638] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:35.013482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:35.023442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bf4d3-0567-4f1d-9742-5aa6fa443b21 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:35.027533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:35.028270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:35.028562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:35.028952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:35.044250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:35.046213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:35.062806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:35.063979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 320/639] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:35.070038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:35.081945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdf812-4a10-47b8-9d92-b4e5391f9000 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:35.087759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778fc02-82a3-4949-96b6-3637dc4b02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:35.088385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778fc02-82a3-4949-96b6-3637dc4b02f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:35.088680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778fc02-82a3-4949-96b6-3637dc4b02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:35.088974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778fc02-82a3-4949-96b6-3637dc4b02f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:35.089719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778fc02-82a3-4949-96b6-3637dc4b02f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:35.090024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778fc02-82a3-4949-96b6-3637dc4b02f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:35.091884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778fc02-82a3-4949-96b6-3637dc4b02f5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:35.104951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 320/640] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:35.110466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:35.119766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892b406-8042-4a83-b2a7-6f24d87ee8c0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:35.123885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f9ade-26d2-4593-a8bc-a7c502e76127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:35.124709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9ade-26d2-4593-a8bc-a7c502e76127 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:35.124997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9ade-26d2-4593-a8bc-a7c502e76127 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:35.125279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f9ade-26d2-4593-a8bc-a7c502e76127 admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/51a85bd55f4749aa9aa37a834229f06b/roles/7077d8abcbbd4c0d82bc6377fb9eec8b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:35.127318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f9ade-26d2-4593-a8bc-a7c502e76127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=51a85bd55f4749aa9aa37a834229f06b, role_id=7077d8abcbbd4c0d82bc6377fb9eec8b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:35.129953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f9ade-26d2-4593-a8bc-a7c502e76127 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:35.142479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 321/641] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:28:35 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/51a85bd55f4749aa9aa37a834229f06b/roles/7077d8abcbbd4c0d82bc6377fb9eec8b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:37.291906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322227fa-883c-4600-9faa-2c968a789077 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.292460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322227fa-883c-4600-9faa-2c968a789077 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.292583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322227fa-883c-4600-9faa-2c968a789077 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.294199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 321/642] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:37.300497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251060-29cd-453b-a795-d77ce290e3f2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.300904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251060-29cd-453b-a795-d77ce290e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.301062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db251060-29cd-453b-a795-d77ce290e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.323969 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-db251060-29cd-453b-a795-d77ce290e3f2 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:37.325109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-db251060-29cd-453b-a795-d77ce290e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:37.390399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 322/643] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:37 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:37.413136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322227fa-883c-4600-9faa-2c968a789077 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.425529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322227fa-883c-4600-9faa-2c968a789077 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.429680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.430400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.430691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.430976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.442462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:37.449299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 08 02:28:37.450367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 322/644] 10.222.0.23 () {56 vars in 1141 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:37.456113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db251060-29cd-453b-a795-d77ce290e3f2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.464616 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db251060-29cd-453b-a795-d77ce290e3f2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.468760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.469342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.469631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.469916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.470692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:37.470995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.472607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.480764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 323/645] 10.222.0.23 () {56 vars in 1136 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:37.486532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.496172 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e2f3a-da9e-4882-b35c-1545842a6575 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.500222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.500916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.501239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.502109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.513134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.514941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.533531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:37.534563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 323/646] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:37.539835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.549700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865b54a-51ab-4f23-bda1-b278aca2ba7d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.554054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.554632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.554925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.555211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.555894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:37.556250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.557839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.569954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 324/647] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:37.574968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.584241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90aebc-d5aa-4751-81aa-e555368fd779 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.588271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.588982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.589269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.589550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.602507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.604526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.622653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 08 02:28:37.623687 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 324/648] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:37.629329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.638450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276187-dd0d-4503-9881-44e00eb32d63 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.642633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.643213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.643503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.643788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.644611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:37.644915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.646702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.675275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 325/649] 10.222.0.23 () {56 vars in 1170 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:37.680936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.690168 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7869-74a1-4200-9a70-123bbc27387b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.694167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.694718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.695006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.695289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.702733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.704618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.712782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 325/650] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:37.717933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.727452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516769f-1b5a-49f8-93d0-7a15a944969a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.731534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.732274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.732567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.732851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.744594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.746380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.762804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:37.763832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 326/651] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:37.769301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.777429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721bc29-c24d-4f3f-a275-281c1454682e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.781554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.782116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.782403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.783426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.783907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:37.784234 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.785759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.797760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 326/652] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:37.803959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.812857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b3107-e185-4e8d-b0b0-e833c86c718f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.817542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.818228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.818515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.818797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.826882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.828825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.842375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:37.843393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 327/653] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:37.849246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.858065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad9621-d5fa-4664-8f36-f81ee0dfd712 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.863047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8fd9d-eee9-4c16-ba1c-c3c5a9c5b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.863604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8fd9d-eee9-4c16-ba1c-c3c5a9c5b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.863894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8fd9d-eee9-4c16-ba1c-c3c5a9c5b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.864209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8fd9d-eee9-4c16-ba1c-c3c5a9c5b9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.864942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8fd9d-eee9-4c16-ba1c-c3c5a9c5b9bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:37.865244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8fd9d-eee9-4c16-ba1c-c3c5a9c5b9bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.867027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8fd9d-eee9-4c16-ba1c-c3c5a9c5b9bb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.879631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 327/654] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:37.885069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:37.894785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7372149-c5c5-4aac-868d-f31b23829902 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:37.898787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483b51f-f406-4db2-9589-4609b575a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:37.899338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b51f-f406-4db2-9589-4609b575a05a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:37.899625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b51f-f406-4db2-9589-4609b575a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:37.899905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b51f-f406-4db2-9589-4609b575a05a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:37.900702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483b51f-f406-4db2-9589-4609b575a05a admin admin] RBAC: Adding query filter params (role.id=7077d8abcbbd4c0d82bc6377fb9eec8b, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=51a85bd55f4749aa9aa37a834229f06b) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:37.901000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483b51f-f406-4db2-9589-4609b575a05a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:37.902777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483b51f-f406-4db2-9589-4609b575a05a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:37.909315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 328/655] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:37 2022] GET /identity/v3/role_assignments?user.id=51a85bd55f4749aa9aa37a834229f06b&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=7077d8abcbbd4c0d82bc6377fb9eec8b => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:39.994897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14044982-4008-4771-8d64-9349cb1877e9 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:39.995425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14044982-4008-4771-8d64-9349cb1877e9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:39.995513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14044982-4008-4771-8d64-9349cb1877e9 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:39.997160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 328/656] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:40.003220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c892d1-ce90-49c8-ba7a-f3bb32726cdf None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:40.003617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c892d1-ce90-49c8-ba7a-f3bb32726cdf None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:40.003796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c892d1-ce90-49c8-ba7a-f3bb32726cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:40.029342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a3c892d1-ce90-49c8-ba7a-f3bb32726cdf None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:40.030499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a3c892d1-ce90-49c8-ba7a-f3bb32726cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:40.037420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 329/657] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:40 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:40.059384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14044982-4008-4771-8d64-9349cb1877e9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:40.071378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14044982-4008-4771-8d64-9349cb1877e9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:40.075306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:40.076035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:40.076329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:40.076615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:40.077237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:40.078805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:40.089842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 08 02:28:40.090866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 329/658] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Apr 8 02:28:40 2022] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:28:40.096876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c892d1-ce90-49c8-ba7a-f3bb32726cdf None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:40.105203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c892d1-ce90-49c8-ba7a-f3bb32726cdf None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:40.109228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87efc5-2fb7-48a8-8102-7c3cf9890a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:40.109800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87efc5-2fb7-48a8-8102-7c3cf9890a69 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:40.110087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87efc5-2fb7-48a8-8102-7c3cf9890a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:40.110370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87efc5-2fb7-48a8-8102-7c3cf9890a69 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:40.111577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87efc5-2fb7-48a8-8102-7c3cf9890a69 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:40.111879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87efc5-2fb7-48a8-8102-7c3cf9890a69 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:40.113490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87efc5-2fb7-48a8-8102-7c3cf9890a69 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:40.117706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 330/659] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:40.122701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:40.132444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d1c62-6c97-4d83-9a7a-56ecd53751a1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:40.136456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8c5b7-eef4-4611-b2c2-1484ceb41dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:40.137010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c5b7-eef4-4611-b2c2-1484ceb41dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:40.137300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c5b7-eef4-4611-b2c2-1484ceb41dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:40.137586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8c5b7-eef4-4611-b2c2-1484ceb41dc5 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:40.138243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c5b7-eef4-4611-b2c2-1484ceb41dc5 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:40.138544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c5b7-eef4-4611-b2c2-1484ceb41dc5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:40.140088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8c5b7-eef4-4611-b2c2-1484ceb41dc5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:40.144757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 330/660] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:42.228295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be018-9bea-4d1a-bd12-ab956a64a6f6 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:42.228819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be018-9bea-4d1a-bd12-ab956a64a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:42.228903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850be018-9bea-4d1a-bd12-ab956a64a6f6 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:42.230504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 331/661] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:42.236226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77a81-760d-4f07-b91e-e3415fd46ebe None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:42.236636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77a81-760d-4f07-b91e-e3415fd46ebe None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:42.236807 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77a81-760d-4f07-b91e-e3415fd46ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:42.258391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-03b77a81-760d-4f07-b91e-e3415fd46ebe None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:42.259538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-03b77a81-760d-4f07-b91e-e3415fd46ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:42.266395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 331/662] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:42 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:42.289857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be018-9bea-4d1a-bd12-ab956a64a6f6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:42.301357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850be018-9bea-4d1a-bd12-ab956a64a6f6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:42.305547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710d309-3349-47a1-b5fe-1147dc4b7f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:42.306121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d309-3349-47a1-b5fe-1147dc4b7f32 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:42.306410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d309-3349-47a1-b5fe-1147dc4b7f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:42.306712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d309-3349-47a1-b5fe-1147dc4b7f32 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:42.307381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710d309-3349-47a1-b5fe-1147dc4b7f32 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:42.308982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710d309-3349-47a1-b5fe-1147dc4b7f32 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:42.322389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 332/663] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:28:42 2022] POST /identity/v3/services => generated 242 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:28:44.473529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497e757-1267-49cd-b2fc-2fb005c56fc5 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.474072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497e757-1267-49cd-b2fc-2fb005c56fc5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.474072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497e757-1267-49cd-b2fc-2fb005c56fc5 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.475754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 332/664] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:44.480896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109249-e9bb-4a99-8aa3-4c62dcbd09a2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.481293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109249-e9bb-4a99-8aa3-4c62dcbd09a2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.481462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8109249-e9bb-4a99-8aa3-4c62dcbd09a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.504424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b8109249-e9bb-4a99-8aa3-4c62dcbd09a2 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:44.505552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b8109249-e9bb-4a99-8aa3-4c62dcbd09a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:44.522634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 333/665] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:44 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:44.545595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497e757-1267-49cd-b2fc-2fb005c56fc5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:44.558236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497e757-1267-49cd-b2fc-2fb005c56fc5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:44.562273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:44.562981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.563276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.563707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] PATH_INFO: `/v3/services/image` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.564372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:44.565953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:44.575987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 08 02:28:44.577021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 333/666] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Apr 8 02:28:44 2022] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:44.582571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109249-e9bb-4a99-8aa3-4c62dcbd09a2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:44.590925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8109249-e9bb-4a99-8aa3-4c62dcbd09a2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:44.595520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:44.596131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.596420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.596704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.597373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] RBAC: Adding query filter params (name=image) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:44.597672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:44.599242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:44.603518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 334/667] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:44.608826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:44.618366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad1577-4b71-4bee-91bd-55022e29df2c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:44.622464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:44.623031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.623325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.623609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.624313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:44.624618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:44.626246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:44.630736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 334/668] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:44.635904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:44.645250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e6bb-8637-488b-a37f-88b511a54aac admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:44.649374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea90a9a-7ab6-4aa2-8ca6-cfed979d031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:44.649930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea90a9a-7ab6-4aa2-8ca6-cfed979d031e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.650222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea90a9a-7ab6-4aa2-8ca6-cfed979d031e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.650506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea90a9a-7ab6-4aa2-8ca6-cfed979d031e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.651238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea90a9a-7ab6-4aa2-8ca6-cfed979d031e admin admin] RBAC: Adding query filter params (interface=public, service_id=7d5dbe09d0554dd5a2cf26a6bdf45527, region_id=RegionOne) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:44.651551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea90a9a-7ab6-4aa2-8ca6-cfed979d031e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:44.653112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea90a9a-7ab6-4aa2-8ca6-cfed979d031e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:44.658782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 335/669] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:28:44 2022] GET /identity/v3/endpoints?service_id=7d5dbe09d0554dd5a2cf26a6bdf45527&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:44.663581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:44.672377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8296e-a780-4eaa-83bd-8bbdfad30dd7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:44.677231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aff4de-6780-46da-840a-2ed8a2ccf850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:44.677790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aff4de-6780-46da-840a-2ed8a2ccf850 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:44.678081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aff4de-6780-46da-840a-2ed8a2ccf850 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:44.678364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aff4de-6780-46da-840a-2ed8a2ccf850 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:44.678995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aff4de-6780-46da-840a-2ed8a2ccf850 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:44.680534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aff4de-6780-46da-840a-2ed8a2ccf850 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:44.685557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 335/670] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:28:44 2022] GET /identity/v3/services => generated 1022 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:28:46.801112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba5776-e433-418f-9f8e-dad0a6221a9b None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.801626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba5776-e433-418f-9f8e-dad0a6221a9b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.801626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba5776-e433-418f-9f8e-dad0a6221a9b None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.803519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 336/671] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:46.808778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774f8b-09ac-41bd-94aa-d2135dcc42a6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.809152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774f8b-09ac-41bd-94aa-d2135dcc42a6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.809355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63774f8b-09ac-41bd-94aa-d2135dcc42a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.832288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-63774f8b-09ac-41bd-94aa-d2135dcc42a6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:46.833419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-63774f8b-09ac-41bd-94aa-d2135dcc42a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:46.840204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 336/672] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:46 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:46.861735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba5776-e433-418f-9f8e-dad0a6221a9b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.873282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba5776-e433-418f-9f8e-dad0a6221a9b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.878040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.878758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.879045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.879329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.879987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.881563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:46.892283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 08 02:28:46.893550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 337/673] 10.222.0.23 () {56 vars in 1126 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:46.899363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63774f8b-09ac-41bd-94aa-d2135dcc42a6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.908091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63774f8b-09ac-41bd-94aa-d2135dcc42a6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.912190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.912765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.913052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.913334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.913998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:46.914298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.915858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:46.920160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 337/674] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:46.925759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.934993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0af81-19c7-4fcf-a08b-073b9a390860 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.939942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e59b2-5607-4749-a77b-8cd49907f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.940518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e59b2-5607-4749-a77b-8cd49907f346 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.940811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e59b2-5607-4749-a77b-8cd49907f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.941097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e59b2-5607-4749-a77b-8cd49907f346 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.941763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e59b2-5607-4749-a77b-8cd49907f346 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:46.942066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e59b2-5607-4749-a77b-8cd49907f346 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.943609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e59b2-5607-4749-a77b-8cd49907f346 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:46.948185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 338/675] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:46.953325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:46.962675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b2f05-0d45-49f9-98d8-86941b4c0771 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:46.966713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64e95a-65f1-405e-87b0-838825eb1555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:46.967277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e95a-65f1-405e-87b0-838825eb1555 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:46.967567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e95a-65f1-405e-87b0-838825eb1555 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:46.967849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64e95a-65f1-405e-87b0-838825eb1555 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:46.968567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64e95a-65f1-405e-87b0-838825eb1555 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:46.970236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64e95a-65f1-405e-87b0-838825eb1555 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:46.987290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 338/676] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:28:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:28:49.091659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756956cf-b367-4a74-93fc-477b6d32af9f None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:49.092378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756956cf-b367-4a74-93fc-477b6d32af9f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:49.092378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756956cf-b367-4a74-93fc-477b6d32af9f None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:49.093900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 339/677] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:49.100228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161d2f-4f2b-41bf-8235-761fe186f3ad None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:49.100668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161d2f-4f2b-41bf-8235-761fe186f3ad None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:49.100808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161d2f-4f2b-41bf-8235-761fe186f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:49.123192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-2d161d2f-4f2b-41bf-8235-761fe186f3ad None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:49.124362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2d161d2f-4f2b-41bf-8235-761fe186f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:49.140581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 339/678] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:49 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:49.163358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756956cf-b367-4a74-93fc-477b6d32af9f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:49.174942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756956cf-b367-4a74-93fc-477b6d32af9f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:49.179115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d5cff-1959-45df-82b4-4f2f4171eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:49.179675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5cff-1959-45df-82b4-4f2f4171eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:49.179998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5cff-1959-45df-82b4-4f2f4171eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:49.180284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d5cff-1959-45df-82b4-4f2f4171eb1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:49.187661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5cff-1959-45df-82b4-4f2f4171eb1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:49.189517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d5cff-1959-45df-82b4-4f2f4171eb1a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:49.198146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 340/679] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:49 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:28:49.203426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d161d2f-4f2b-41bf-8235-761fe186f3ad None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:49.212502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d161d2f-4f2b-41bf-8235-761fe186f3ad None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:49.216652 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af470c6-ea15-4d2e-90d2-8db429895df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:49.217538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af470c6-ea15-4d2e-90d2-8db429895df9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:49.217840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af470c6-ea15-4d2e-90d2-8db429895df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:49.218129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af470c6-ea15-4d2e-90d2-8db429895df9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:49.219222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af470c6-ea15-4d2e-90d2-8db429895df9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:49.221678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af470c6-ea15-4d2e-90d2-8db429895df9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:49.223103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 340/680] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:51.549357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcd87-9e7f-4cff-9992-6b3b73c568d2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.549877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcd87-9e7f-4cff-9992-6b3b73c568d2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.550205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efdcd87-9e7f-4cff-9992-6b3b73c568d2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.552209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 341/681] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:51.557547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a76d9-e759-4a71-9415-ad8cec028f35 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.557970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a76d9-e759-4a71-9415-ad8cec028f35 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.558130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a76d9-e759-4a71-9415-ad8cec028f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.581258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-446a76d9-e759-4a71-9415-ad8cec028f35 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:51.582411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-446a76d9-e759-4a71-9415-ad8cec028f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:51.589320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 341/682] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:51 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:51.613206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcd87-9e7f-4cff-9992-6b3b73c568d2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.624644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efdcd87-9e7f-4cff-9992-6b3b73c568d2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.629469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.630200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.630488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.630769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.643813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.645639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:51.662001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:51.663064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 342/683] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:51.669145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a76d9-e759-4a71-9415-ad8cec028f35 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.678439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a76d9-e759-4a71-9415-ad8cec028f35 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.682549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74069141-af98-4d8e-ba97-640b897662bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.683127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069141-af98-4d8e-ba97-640b897662bd admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.683418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069141-af98-4d8e-ba97-640b897662bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.683702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74069141-af98-4d8e-ba97-640b897662bd admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.684428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74069141-af98-4d8e-ba97-640b897662bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:51.684732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74069141-af98-4d8e-ba97-640b897662bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.686295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74069141-af98-4d8e-ba97-640b897662bd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:51.698790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 342/684] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:51.704104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:51.713310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc726-24e6-4679-b93c-260bb7da1cd0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:51.717390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c350c9-d0b6-4168-95c8-8a44c2a7b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:51.717965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c350c9-d0b6-4168-95c8-8a44c2a7b460 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:51.718255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c350c9-d0b6-4168-95c8-8a44c2a7b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:51.718540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c350c9-d0b6-4168-95c8-8a44c2a7b460 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:51.719183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c350c9-d0b6-4168-95c8-8a44c2a7b460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:51.721287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c350c9-d0b6-4168-95c8-8a44c2a7b460 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:51.740585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 343/685] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:28:51 2022] POST /identity/v3/users => generated 248 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:28:53.844287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daecd1-8ded-43d9-be87-e2c1c9346fd5 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.844792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daecd1-8ded-43d9-be87-e2c1c9346fd5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.844941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daecd1-8ded-43d9-be87-e2c1c9346fd5 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.846624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 343/686] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:53.851672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1303aa-8ee2-4b80-9e1a-9d7fd836e9c3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.852106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1303aa-8ee2-4b80-9e1a-9d7fd836e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.852266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1303aa-8ee2-4b80-9e1a-9d7fd836e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.874172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-7c1303aa-8ee2-4b80-9e1a-9d7fd836e9c3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:53.875314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7c1303aa-8ee2-4b80-9e1a-9d7fd836e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:53.882690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 344/687] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:53 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:28:53.905430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daecd1-8ded-43d9-be87-e2c1c9346fd5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.917177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daecd1-8ded-43d9-be87-e2c1c9346fd5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.921227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.921936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.922232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.923117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.934301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:53.941411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:53.942483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 344/688] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:53.948152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1303aa-8ee2-4b80-9e1a-9d7fd836e9c3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.956688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1303aa-8ee2-4b80-9e1a-9d7fd836e9c3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.960774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.961354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.961645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.961930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:53.962643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:53.962946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:53.964558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:53.973244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 345/689] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:53.978358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:53.988541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da401d2-2340-4539-b9e5-f1597ad7929b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:53.992709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:53.993400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:53.993696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:53.993985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.005705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.007528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.024241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:54.025297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 345/690] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:54.030575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.040205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165133c-afa9-46fd-838a-79bf496b6f71 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.044306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.044876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.045164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.045473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.046153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:54.046455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.048800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.061030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 346/691] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:54.066057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.075102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1841018-cb31-4789-86d7-e2c9cd9d4815 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.079375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.080113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.080408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.080695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.092945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.095630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.113572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:28:54.114607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 346/692] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:54.119878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.129175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c1daa-a203-4441-afc3-d6875c23e748 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.133266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.133839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.134128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.134411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.135183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:54.135484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.137300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.165442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 347/693] 10.222.0.23 () {56 vars in 1158 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:54.170663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.180768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee0664-6137-464c-a985-3b4d31237884 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.184908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.185465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.185754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.186038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.193526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.195260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.203449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 347/694] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:28:54.208445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.217366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd31cc-396e-47ba-bba5-ab758840ca23 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.222526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.223225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.223515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.223801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.235653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.237461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.253879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:54.254926 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 348/695] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:54.260378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.268740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f1e4c-838f-4f0b-a4b8-c11f54dcda6a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.272936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.273511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.273803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.274090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.274783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:54.275088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.276679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.290663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 348/696] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:54.295742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.305643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1804d-a221-4ae6-aff5-4d0c1d3c73f6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.309729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.310427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.310717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.311000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.319203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.325280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.338679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:54.339727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 349/697] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:54.346119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.355157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744ed89-260c-4253-8a98-277682b92a12 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.359232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5dbc1-afc3-4bac-be2f-8205888b09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.360472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5dbc1-afc3-4bac-be2f-8205888b09b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.361232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5dbc1-afc3-4bac-be2f-8205888b09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.361522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5dbc1-afc3-4bac-be2f-8205888b09b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.362264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5dbc1-afc3-4bac-be2f-8205888b09b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:54.362567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5dbc1-afc3-4bac-be2f-8205888b09b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.364392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5dbc1-afc3-4bac-be2f-8205888b09b4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.377447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 349/698] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:54.382964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:54.392684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1fbe4-b7a8-4c0f-b992-647744d329f5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:54.396807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83205-c374-49b7-93e1-745035116c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:54.397370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83205-c374-49b7-93e1-745035116c8a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:54.397660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83205-c374-49b7-93e1-745035116c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:54.397943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83205-c374-49b7-93e1-745035116c8a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:54.398718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83205-c374-49b7-93e1-745035116c8a admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=0e240ede71df43708e2fb859c99b0a23) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:54.399023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83205-c374-49b7-93e1-745035116c8a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:54.400860 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83205-c374-49b7-93e1-745035116c8a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:54.406000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 350/699] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:54 2022] GET /identity/v3/role_assignments?user.id=0e240ede71df43708e2fb859c99b0a23&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:56.522691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2086-ae47-4a7f-9847-3851ce339c2d None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.523189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2086-ae47-4a7f-9847-3851ce339c2d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.523311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e2086-ae47-4a7f-9847-3851ce339c2d None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.524931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 350/700] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:56.529919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332954-2d39-4f77-a946-528c19ff2935 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.530283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332954-2d39-4f77-a946-528c19ff2935 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.530504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332954-2d39-4f77-a946-528c19ff2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.553840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-3b332954-2d39-4f77-a946-528c19ff2935 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:56.554988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3b332954-2d39-4f77-a946-528c19ff2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:56.561905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 351/701] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:56 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:56.583654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2086-ae47-4a7f-9847-3851ce339c2d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.595546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e2086-ae47-4a7f-9847-3851ce339c2d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.599497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.600224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.600513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.600796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.611669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:56.618017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:56.619072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 351/702] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.624571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332954-2d39-4f77-a946-528c19ff2935 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.633719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332954-2d39-4f77-a946-528c19ff2935 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.637867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.638457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.638750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.639033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.639747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:56.640089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.642294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.650469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 352/703] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:56.655765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.665395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4fd42-b6c1-4015-b7bc-8ccfa0fc76d6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.669772 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.670474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.670765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.671047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.683057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.684910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.702267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:56.703313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 352/704] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.708702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.717724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8895a7-2434-4b75-828a-f0416e1e12bc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.722320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.722895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.723186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.723474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.724185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:56.724488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.726041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.738665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 353/705] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:56.743665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.753212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36eb04-8fe4-4626-8c97-c8def1003717 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.757237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.757926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.758211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.758490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.770779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.772792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.789880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:28:56.790896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 353/706] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.796068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.805859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d53fe2-3679-4883-89ec-f5161a9ba1a4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.809968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.810552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.810842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.811125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.811908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:56.812236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.814618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.843055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 354/707] 10.222.0.23 () {56 vars in 1158 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:56.848195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.857121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c5aca-86dd-4753-a123-40923250d530 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.861722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.862407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.862697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.862980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.874258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.876908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.893104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:56.894120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 354/708] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.899296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.908396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9827c-c7c6-4b94-b816-52185221e265 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.912512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.913085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.913377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.913661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.914341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:56.914640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.916228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.930840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 355/709] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:56.936314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.946087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d8d43-5e7e-456f-b332-c94d10653e8c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.950240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.950948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.951245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.951534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.959835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.961799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:56.975162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:56.976236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 355/710] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:56.981487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:56.991109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d8488-d46d-4944-8f1e-6f88b5ef423a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:56.995169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77607168-c0b2-4cac-a0a8-19fa17eed1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:56.995746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607168-c0b2-4cac-a0a8-19fa17eed1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:56.996081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607168-c0b2-4cac-a0a8-19fa17eed1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:56.996369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77607168-c0b2-4cac-a0a8-19fa17eed1e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:56.997109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77607168-c0b2-4cac-a0a8-19fa17eed1e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:56.997413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77607168-c0b2-4cac-a0a8-19fa17eed1e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:56.999217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77607168-c0b2-4cac-a0a8-19fa17eed1e3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:57.013273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 356/711] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:57.018697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:57.027787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090c87e-83ca-4015-b627-2ee7978a5712 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:57.032514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359338e8-a5ef-4399-ad76-b78d0bec4a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:57.033395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359338e8-a5ef-4399-ad76-b78d0bec4a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:57.033691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359338e8-a5ef-4399-ad76-b78d0bec4a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:57.033982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359338e8-a5ef-4399-ad76-b78d0bec4a11 admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/0e240ede71df43708e2fb859c99b0a23/roles/58f38def815542948bd51acfd4644ea3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:57.054086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359338e8-a5ef-4399-ad76-b78d0bec4a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=0e240ede71df43708e2fb859c99b0a23, role_id=58f38def815542948bd51acfd4644ea3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:57.056727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359338e8-a5ef-4399-ad76-b78d0bec4a11 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:57.069437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 356/712] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:28:57 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/0e240ede71df43708e2fb859c99b0a23/roles/58f38def815542948bd51acfd4644ea3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:28:59.133811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153efaa-59f1-4b2c-bbee-40259ce4b166 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.134362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153efaa-59f1-4b2c-bbee-40259ce4b166 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.134362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2153efaa-59f1-4b2c-bbee-40259ce4b166 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.136190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 357/713] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:28:59.141240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d809-f064-4e2f-8589-b6948f003b10 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.141634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d809-f064-4e2f-8589-b6948f003b10 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.141830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d809-f064-4e2f-8589-b6948f003b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.164817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7548d809-f064-4e2f-8589-b6948f003b10 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:28:59.165951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7548d809-f064-4e2f-8589-b6948f003b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:28:59.228637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 357/714] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:28:59 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:28:59.251703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153efaa-59f1-4b2c-bbee-40259ce4b166 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.263434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2153efaa-59f1-4b2c-bbee-40259ce4b166 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.268179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.268889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.269174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.269458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.280463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:28:59.286891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:28:59.287984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 358/715] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.293865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d809-f064-4e2f-8589-b6948f003b10 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.302937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d809-f064-4e2f-8589-b6948f003b10 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.307105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.307696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.308046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.308338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.309080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:59.309384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.310961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.319707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 358/716] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.324769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.334870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc372-49ea-4f51-8289-7c8f4aa0fe7d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.339026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.339711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.340046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.340332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.351301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.353141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.369912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:59.370944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 359/717] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.376925 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.386006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d55eb1-22d0-4e29-a1fd-2588b97babc6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.390030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.390600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.390893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.391806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.392531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:59.392837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.394387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.406469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 359/718] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.411500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.420525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0331c-cf86-47b0-b109-d0cf0a96693a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.424768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.425464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.425755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.426042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.439036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.441116 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.458879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:28:59.459946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 360/719] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.465330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.474677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed167904-47aa-43a3-b64d-952099196a49 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.478788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.479371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.479657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.479955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.480747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:59.481051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.482880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.512780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 360/720] 10.222.0.23 () {56 vars in 1158 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:28:59.518964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.528242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aae217-3da3-4fb8-91a4-0d4ad910e483 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.532366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.532928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.533221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.533510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.541052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.542778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.551532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 361/721] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:28:59.557002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.566699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b77d4-7800-4127-b2a6-e5a94514062d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.570758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.571484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.571771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.572087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.584346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.586463 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.603224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:28:59.604282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 361/722] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.609496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.618490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a0d7f-4e77-4c20-b0d5-56b8631bd707 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.622670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.623245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.623537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.623824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.624537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:59.624846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.626464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.638633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 362/723] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.644548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.653375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb3eb3-7b2d-48dc-ab80-4a7e42f3789b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.658007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.658692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.658981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.659266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.667414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.669338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.683812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:28:59.684883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 362/724] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:28:59.690611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.699783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436c1c9-de77-4bba-a220-ea56353d200a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.704612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf7c9d-5701-4440-a200-9b36d3d8ecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.705194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7c9d-5701-4440-a200-9b36d3d8ecde admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.705490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7c9d-5701-4440-a200-9b36d3d8ecde admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.705780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf7c9d-5701-4440-a200-9b36d3d8ecde admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.706523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf7c9d-5701-4440-a200-9b36d3d8ecde admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:59.706835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf7c9d-5701-4440-a200-9b36d3d8ecde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.708688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf7c9d-5701-4440-a200-9b36d3d8ecde admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.721134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 363/725] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:28:59.726515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:28:59.736308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932b9af-1113-46fb-8c00-b1e431527236 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:28:59.740393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fd8a-7c84-4189-aecd-f12bb206c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:28:59.740948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fd8a-7c84-4189-aecd-f12bb206c3fd admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:28:59.741238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fd8a-7c84-4189-aecd-f12bb206c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:28:59.741519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fd8a-7c84-4189-aecd-f12bb206c3fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:28:59.742287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fd8a-7c84-4189-aecd-f12bb206c3fd admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=0e240ede71df43708e2fb859c99b0a23) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:28:59.742591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fd8a-7c84-4189-aecd-f12bb206c3fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:28:59.744426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fd8a-7c84-4189-aecd-f12bb206c3fd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:28:59.749859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 363/726] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:28:59 2022] GET /identity/v3/role_assignments?user.id=0e240ede71df43708e2fb859c99b0a23&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:01.861280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c685c-930c-492b-b346-607c4e5d809f None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:01.861858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c685c-930c-492b-b346-607c4e5d809f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:01.861858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c685c-930c-492b-b346-607c4e5d809f None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:01.863506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 364/727] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:01.868679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf7f2-d2a1-4c65-9929-13786bbe3e13 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:01.869065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf7f2-d2a1-4c65-9929-13786bbe3e13 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:01.869255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf7f2-d2a1-4c65-9929-13786bbe3e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:01.891476 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e71bf7f2-d2a1-4c65-9929-13786bbe3e13 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:01.892648 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e71bf7f2-d2a1-4c65-9929-13786bbe3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:01.899360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 364/728] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:01 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:01.921001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c685c-930c-492b-b346-607c4e5d809f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:01.933633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c685c-930c-492b-b346-607c4e5d809f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:01.937621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:01.939001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:01.939293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:01.939582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:01.940247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:01.941829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:01.952456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 08 02:29:01.953490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 365/729] 10.222.0.23 () {56 vars in 1150 bytes} [Fri Apr 8 02:29:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:01.958870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf7f2-d2a1-4c65-9929-13786bbe3e13 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:01.967240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf7f2-d2a1-4c65-9929-13786bbe3e13 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:01.971414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0b38c-dddd-4be0-936f-95470b291fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:01.972020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b38c-dddd-4be0-936f-95470b291fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:01.972313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b38c-dddd-4be0-936f-95470b291fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:01.972597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0b38c-dddd-4be0-936f-95470b291fc3 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:01.973266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b38c-dddd-4be0-936f-95470b291fc3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:01.973565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b38c-dddd-4be0-936f-95470b291fc3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:01.975116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0b38c-dddd-4be0-936f-95470b291fc3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:01.979388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 365/730] 10.222.0.23 () {56 vars in 1145 bytes} [Fri Apr 8 02:29:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:01.985179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:01.994205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650b73b-2951-43ad-886a-4f1a0db9077c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:01.998324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdd0ad-2c71-423e-9841-1b3029dced98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:01.998894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd0ad-2c71-423e-9841-1b3029dced98 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:01.999189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd0ad-2c71-423e-9841-1b3029dced98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:01.999508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdd0ad-2c71-423e-9841-1b3029dced98 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:02.000217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdd0ad-2c71-423e-9841-1b3029dced98 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:02.000561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdd0ad-2c71-423e-9841-1b3029dced98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:02.002113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdd0ad-2c71-423e-9841-1b3029dced98 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:02.006248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 366/731] 10.222.0.23 () {56 vars in 1145 bytes} [Fri Apr 8 02:29:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:04.076167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5128b-4471-4c31-9ac1-1e95cd43f303 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.076691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5128b-4471-4c31-9ac1-1e95cd43f303 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.076806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5128b-4471-4c31-9ac1-1e95cd43f303 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.078465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 366/732] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:04.083691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de80ac-a3ba-43d4-93c5-40606afc4136 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.084128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de80ac-a3ba-43d4-93c5-40606afc4136 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.084292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de80ac-a3ba-43d4-93c5-40606afc4136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.106264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-75de80ac-a3ba-43d4-93c5-40606afc4136 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:04.107389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-75de80ac-a3ba-43d4-93c5-40606afc4136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:04.114953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 367/733] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:04 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:04.136775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5128b-4471-4c31-9ac1-1e95cd43f303 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:04.149145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5128b-4471-4c31-9ac1-1e95cd43f303 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:04.153048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13287f03-c9f0-40c5-9f5d-254a32655a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:04.153649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287f03-c9f0-40c5-9f5d-254a32655a7e admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:04.153937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287f03-c9f0-40c5-9f5d-254a32655a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:04.154219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287f03-c9f0-40c5-9f5d-254a32655a7e admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:04.154889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13287f03-c9f0-40c5-9f5d-254a32655a7e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:04.157141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13287f03-c9f0-40c5-9f5d-254a32655a7e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:04.169694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 367/734] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:29:04 2022] POST /identity/v3/services => generated 251 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:29:06.327727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbf66-4b96-4d12-a523-1689125133ab None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:06.328358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbf66-4b96-4d12-a523-1689125133ab None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:06.328358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbf66-4b96-4d12-a523-1689125133ab None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:06.330656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 368/735] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:29:06.337234 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da499b5-5b8f-4e14-98fc-e7cb521a27c6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:06.337667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da499b5-5b8f-4e14-98fc-e7cb521a27c6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:06.337829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da499b5-5b8f-4e14-98fc-e7cb521a27c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:06.362009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3da499b5-5b8f-4e14-98fc-e7cb521a27c6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:06.363217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3da499b5-5b8f-4e14-98fc-e7cb521a27c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:06.382642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 368/736] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:06 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:06.405367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdbf66-4b96-4d12-a523-1689125133ab None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:06.417073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdbf66-4b96-4d12-a523-1689125133ab None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:06.421088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:06.421810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:06.422612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:06.422612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:06.423507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:06.425112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:06.436018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 08 02:29:06.437067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 369/737] 10.222.0.23 () {56 vars in 1150 bytes} [Fri Apr 8 02:29:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:06.443425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da499b5-5b8f-4e14-98fc-e7cb521a27c6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:06.452115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da499b5-5b8f-4e14-98fc-e7cb521a27c6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:06.456757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:06.457343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:06.457639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:06.457928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:06.458606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:06.458915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:06.460520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:06.465088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 369/738] 10.222.0.23 () {56 vars in 1145 bytes} [Fri Apr 8 02:29:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:06.470517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:06.479699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd88107-dee3-4f0e-956b-0e0d29dfbbbe admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:06.483864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971522ac-974c-4699-9459-feee852e775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:06.485020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971522ac-974c-4699-9459-feee852e775d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:06.485588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971522ac-974c-4699-9459-feee852e775d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:06.485692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971522ac-974c-4699-9459-feee852e775d admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:06.486333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971522ac-974c-4699-9459-feee852e775d admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:06.486639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971522ac-974c-4699-9459-feee852e775d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:06.488230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971522ac-974c-4699-9459-feee852e775d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:06.492847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 370/739] 10.222.0.23 () {56 vars in 1145 bytes} [Fri Apr 8 02:29:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:06.498357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:06.508204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec21414-6782-4e6a-a94d-d36634275e21 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:06.513466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d8780-548c-4fbd-9ad5-5d883abfc98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:06.514039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d8780-548c-4fbd-9ad5-5d883abfc98c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:06.514334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d8780-548c-4fbd-9ad5-5d883abfc98c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:06.514621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d8780-548c-4fbd-9ad5-5d883abfc98c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:06.515365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d8780-548c-4fbd-9ad5-5d883abfc98c admin admin] RBAC: Adding query filter params (interface=public, service_id=54570efc88654dbbbf348ee9aa2305c0, region_id=RegionOne) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:06.515678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d8780-548c-4fbd-9ad5-5d883abfc98c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:06.517331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d8780-548c-4fbd-9ad5-5d883abfc98c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:06.522338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 370/740] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:29:06 2022] GET /identity/v3/endpoints?service_id=54570efc88654dbbbf348ee9aa2305c0&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:06.527261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971522ac-974c-4699-9459-feee852e775d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:06.536583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971522ac-974c-4699-9459-feee852e775d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:06.540691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4fe27-e0fd-4ebb-a5c7-b36269cd257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:06.541256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4fe27-e0fd-4ebb-a5c7-b36269cd257a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:06.541543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4fe27-e0fd-4ebb-a5c7-b36269cd257a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:06.541824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4fe27-e0fd-4ebb-a5c7-b36269cd257a admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:06.542463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4fe27-e0fd-4ebb-a5c7-b36269cd257a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:06.544016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4fe27-e0fd-4ebb-a5c7-b36269cd257a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:06.550251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 371/741] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:29:06 2022] GET /identity/v3/services => generated 1261 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:29:08.649059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9402433-9dad-4501-b88b-3c9ddca81ed6 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:08.649593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9402433-9dad-4501-b88b-3c9ddca81ed6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:08.649683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9402433-9dad-4501-b88b-3c9ddca81ed6 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:08.651305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 371/742] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:08.656568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15cac-2cc6-476c-984e-4325bc60c39b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:08.657004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15cac-2cc6-476c-984e-4325bc60c39b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:08.657150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d15cac-2cc6-476c-984e-4325bc60c39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:08.680079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-68d15cac-2cc6-476c-984e-4325bc60c39b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:08.681211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-68d15cac-2cc6-476c-984e-4325bc60c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:08.688487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 372/743] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:08 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:08.711184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9402433-9dad-4501-b88b-3c9ddca81ed6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:08.723582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9402433-9dad-4501-b88b-3c9ddca81ed6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:08.727622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:08.728387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:08.728684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:08.728972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:08.729599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:08.731185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:08.742136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 08 02:29:08.743126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 372/744] 10.222.0.23 () {56 vars in 1150 bytes} [Fri Apr 8 02:29:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:08.748861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d15cac-2cc6-476c-984e-4325bc60c39b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:08.757396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d15cac-2cc6-476c-984e-4325bc60c39b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:08.761540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:08.762119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:08.762410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:08.762694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:08.763365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:08.763669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:08.765280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:08.770210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 373/745] 10.222.0.23 () {56 vars in 1145 bytes} [Fri Apr 8 02:29:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:08.775399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:08.785134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ab3af-13aa-4260-a277-85084fd0537e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:08.789297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b82d9-2066-49ea-a53c-fa74477eefcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:08.789867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b82d9-2066-49ea-a53c-fa74477eefcc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:08.790162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b82d9-2066-49ea-a53c-fa74477eefcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:08.790452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b82d9-2066-49ea-a53c-fa74477eefcc admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:08.791121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b82d9-2066-49ea-a53c-fa74477eefcc admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:08.791428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b82d9-2066-49ea-a53c-fa74477eefcc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:08.793020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b82d9-2066-49ea-a53c-fa74477eefcc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:08.797611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 373/746] 10.222.0.23 () {56 vars in 1145 bytes} [Fri Apr 8 02:29:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:08.802828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:08.811849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3c7e0-907c-467a-985a-b49dd5108349 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:08.817306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203e404-8fa8-4938-9206-879d41b2cd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:08.817884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e404-8fa8-4938-9206-879d41b2cd12 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:08.818177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e404-8fa8-4938-9206-879d41b2cd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:08.818464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e404-8fa8-4938-9206-879d41b2cd12 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:08.819162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203e404-8fa8-4938-9206-879d41b2cd12 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:08.820761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203e404-8fa8-4938-9206-879d41b2cd12 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:08.838336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 374/747] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:29:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:10.990707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29286f-3f29-4343-846f-87264ee8405d None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:10.991258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29286f-3f29-4343-846f-87264ee8405d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:10.991258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29286f-3f29-4343-846f-87264ee8405d None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:10.993074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 374/748] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:10.998132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f62e3-368a-4181-b3a4-79d41953c4a4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:10.998512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f62e3-368a-4181-b3a4-79d41953c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:10.998697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f62e3-368a-4181-b3a4-79d41953c4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.021430 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f77f62e3-368a-4181-b3a4-79d41953c4a4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:11.022558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f77f62e3-368a-4181-b3a4-79d41953c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:11.039440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 375/749] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:10 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:11.061748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29286f-3f29-4343-846f-87264ee8405d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:11.073577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29286f-3f29-4343-846f-87264ee8405d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:11.077542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:11.079254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:11.079545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:11.079827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.080474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:11.082035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:11.092159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 08 02:29:11.093179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 375/750] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:11 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:11.099255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f62e3-368a-4181-b3a4-79d41953c4a4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:11.107648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f62e3-368a-4181-b3a4-79d41953c4a4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:11.111977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2705d-868f-4674-94bc-b6199ef34323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:11.112561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2705d-868f-4674-94bc-b6199ef34323 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:11.112852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2705d-868f-4674-94bc-b6199ef34323 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:11.113137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2705d-868f-4674-94bc-b6199ef34323 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.113814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2705d-868f-4674-94bc-b6199ef34323 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:11.114124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2705d-868f-4674-94bc-b6199ef34323 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:11.115689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2705d-868f-4674-94bc-b6199ef34323 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:11.120133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 376/751] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:11 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:11.125519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:11.134985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3c50a-69e8-4af3-9bfe-7d8fc5b54d85 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:11.139100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf8da1-a7e8-44f5-8f18-86ef2d5fa4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:11.139655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8da1-a7e8-44f5-8f18-86ef2d5fa4ff admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:11.139977 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8da1-a7e8-44f5-8f18-86ef2d5fa4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:11.140269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf8da1-a7e8-44f5-8f18-86ef2d5fa4ff admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:11.141441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf8da1-a7e8-44f5-8f18-86ef2d5fa4ff admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:11.141825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf8da1-a7e8-44f5-8f18-86ef2d5fa4ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:11.143358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf8da1-a7e8-44f5-8f18-86ef2d5fa4ff admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:11.147526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 376/752] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:11 2022] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:13.276822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876abee-9630-46d8-a87b-6400130a9aee None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:13.277373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876abee-9630-46d8-a87b-6400130a9aee None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:13.277373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876abee-9630-46d8-a87b-6400130a9aee None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:13.279067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 377/753] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:13.284855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ce37-14ad-45c6-a4ca-f3d41f51902b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:13.285266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ce37-14ad-45c6-a4ca-f3d41f51902b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:13.285432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0ce37-14ad-45c6-a4ca-f3d41f51902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:13.307039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-23a0ce37-14ad-45c6-a4ca-f3d41f51902b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:13.308198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-23a0ce37-14ad-45c6-a4ca-f3d41f51902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:13.315014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 377/754] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:13 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:13.337090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876abee-9630-46d8-a87b-6400130a9aee None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:13.349333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876abee-9630-46d8-a87b-6400130a9aee None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:13.353376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d0f4f-584c-485b-b437-ad50b3237ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:13.353960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d0f4f-584c-485b-b437-ad50b3237ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:13.354254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d0f4f-584c-485b-b437-ad50b3237ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:13.354540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d0f4f-584c-485b-b437-ad50b3237ff1 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:13.355229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d0f4f-584c-485b-b437-ad50b3237ff1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:13.356840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d0f4f-584c-485b-b437-ad50b3237ff1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:13.369418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 378/755] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:29:13 2022] POST /identity/v3/services => generated 251 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:15.472280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f118-c62c-4e2c-9c2f-6a06f46d0490 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:15.472827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f118-c62c-4e2c-9c2f-6a06f46d0490 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:15.472827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5f118-c62c-4e2c-9c2f-6a06f46d0490 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:15.474507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 378/756] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:15.479695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1952-c471-4175-9e16-7b40b1b1fa0d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:15.480116 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1952-c471-4175-9e16-7b40b1b1fa0d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:15.480305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1952-c471-4175-9e16-7b40b1b1fa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:15.501751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-78cb1952-c471-4175-9e16-7b40b1b1fa0d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:15.502886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-78cb1952-c471-4175-9e16-7b40b1b1fa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:15.519516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 379/757] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:15 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:15.542138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5f118-c62c-4e2c-9c2f-6a06f46d0490 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:15.554016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5f118-c62c-4e2c-9c2f-6a06f46d0490 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:15.557949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:15.558654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:15.558944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:15.559226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:15.559844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:15.561435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:15.571543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 08 02:29:15.572754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 379/758] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:15 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:15.578679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1952-c471-4175-9e16-7b40b1b1fa0d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:15.587065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1952-c471-4175-9e16-7b40b1b1fa0d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:15.591201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:15.591787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:15.592121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:15.592409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:15.593089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:15.593396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:15.595554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:15.600013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 380/759] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:15 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:15.605177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:15.614260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b23cc-f279-448a-9c41-a1491ecfaa20 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:15.618436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:15.619015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:15.619310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:15.619598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:15.620295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:15.620599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:15.622134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:15.626779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 380/760] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:15 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:15.632007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:15.641408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c660e-0a92-42cf-8bb0-7c02b7e057e3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:15.645574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd7457-7556-4329-b2dc-cacd6c734f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:15.646140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7457-7556-4329-b2dc-cacd6c734f64 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:15.646578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7457-7556-4329-b2dc-cacd6c734f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:15.646916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd7457-7556-4329-b2dc-cacd6c734f64 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:15.647663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7457-7556-4329-b2dc-cacd6c734f64 admin admin] RBAC: Adding query filter params (interface=public, service_id=f937a2c7122b421d9df965b271621a0a, region_id=RegionOne) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:15.648049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7457-7556-4329-b2dc-cacd6c734f64 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:15.651102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd7457-7556-4329-b2dc-cacd6c734f64 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:15.659798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 381/761] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:29:15 2022] GET /identity/v3/endpoints?service_id=f937a2c7122b421d9df965b271621a0a&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:15.665373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:15.674923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4f8b5-db3f-4736-8428-62258dea3827 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:15.679384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2a04e-6f11-4790-bb4d-9ebcfba01b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:15.680002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a04e-6f11-4790-bb4d-9ebcfba01b03 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:15.680301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a04e-6f11-4790-bb4d-9ebcfba01b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:15.680590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2a04e-6f11-4790-bb4d-9ebcfba01b03 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:15.681246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a04e-6f11-4790-bb4d-9ebcfba01b03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:15.682824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2a04e-6f11-4790-bb4d-9ebcfba01b03 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:15.688556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 381/762] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:29:15 2022] GET /identity/v3/services => generated 1500 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:29:17.775290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09271-d17f-449a-9975-1a3e931187a5 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:17.775800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09271-d17f-449a-9975-1a3e931187a5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:17.775800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09271-d17f-449a-9975-1a3e931187a5 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:17.777650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 382/763] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:17.783572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a94db-28ab-4361-9885-ae8fae5ba520 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:17.783986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a94db-28ab-4361-9885-ae8fae5ba520 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:17.784176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a94db-28ab-4361-9885-ae8fae5ba520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:17.806143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-fa8a94db-28ab-4361-9885-ae8fae5ba520 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:17.807283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-fa8a94db-28ab-4361-9885-ae8fae5ba520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:17.814253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 382/764] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:17 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:17.836923 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09271-d17f-449a-9975-1a3e931187a5 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:17.849286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09271-d17f-449a-9975-1a3e931187a5 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:17.853257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:17.853960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:17.854248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:17.854527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:17.855138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:17.856742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:17.867471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Apr 08 02:29:17.868544 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 383/765] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:17 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:17.874437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a94db-28ab-4361-9885-ae8fae5ba520 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:17.883390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a94db-28ab-4361-9885-ae8fae5ba520 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:17.887467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:17.888077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:17.888370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:17.888655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:17.889321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:17.889624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:17.892121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:17.896568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 383/766] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:17 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:17.901711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:17.911327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb3447-b5b0-46d4-9185-c148bf4cdc56 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:17.915383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f232a49-5ce2-458d-94fe-450309b2a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:17.915975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232a49-5ce2-458d-94fe-450309b2a70a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:17.916266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232a49-5ce2-458d-94fe-450309b2a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:17.916547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f232a49-5ce2-458d-94fe-450309b2a70a admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:17.917205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232a49-5ce2-458d-94fe-450309b2a70a admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:17.917505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232a49-5ce2-458d-94fe-450309b2a70a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:17.919040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f232a49-5ce2-458d-94fe-450309b2a70a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:17.923677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 384/767] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:17 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:17.928979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:17.937887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13e3c-9cd5-444d-a11e-730084641be0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:17.942005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd87c7-1491-4900-92c4-caf098cc746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:17.942563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd87c7-1491-4900-92c4-caf098cc746f admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:17.942856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd87c7-1491-4900-92c4-caf098cc746f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:17.943143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd87c7-1491-4900-92c4-caf098cc746f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:17.943834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd87c7-1491-4900-92c4-caf098cc746f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:17.945408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd87c7-1491-4900-92c4-caf098cc746f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:17.963702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 384/768] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:29:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:29:20.104777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0f6c-8e87-4414-bc88-8f9837834ea7 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.105298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0f6c-8e87-4414-bc88-8f9837834ea7 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.105380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0f6c-8e87-4414-bc88-8f9837834ea7 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.107113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 385/769] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:20.112871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120abc5-6de4-401c-943c-ac4c5b106999 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.113238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120abc5-6de4-401c-943c-ac4c5b106999 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.113461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120abc5-6de4-401c-943c-ac4c5b106999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.135578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5120abc5-6de4-401c-943c-ac4c5b106999 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:20.136756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5120abc5-6de4-401c-943c-ac4c5b106999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:20.153105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 385/770] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:20 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:20.175390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0f6c-8e87-4414-bc88-8f9837834ea7 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:20.187346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0f6c-8e87-4414-bc88-8f9837834ea7 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:20.191454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:20.192193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.192481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.192763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.193384 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:20.194944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:20.205639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 08 02:29:20.206673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 386/771] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:20.212361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120abc5-6de4-401c-943c-ac4c5b106999 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:20.221465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120abc5-6de4-401c-943c-ac4c5b106999 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:20.225685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44e27-f5f9-4c00-bcd3-a6189a63f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:20.226261 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44e27-f5f9-4c00-bcd3-a6189a63f5cc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.226555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44e27-f5f9-4c00-bcd3-a6189a63f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.226845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44e27-f5f9-4c00-bcd3-a6189a63f5cc admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.227525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44e27-f5f9-4c00-bcd3-a6189a63f5cc admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:20.227833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44e27-f5f9-4c00-bcd3-a6189a63f5cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:20.229446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44e27-f5f9-4c00-bcd3-a6189a63f5cc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:20.234067 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 386/772] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:20.239386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:20.248891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2ac4-9c53-4d41-be64-f25f7378bad6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:20.253818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f04c-a5cc-4f0d-8fd2-e96e7806d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:20.254383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f04c-a5cc-4f0d-8fd2-e96e7806d0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:20.254675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f04c-a5cc-4f0d-8fd2-e96e7806d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:20.254962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f04c-a5cc-4f0d-8fd2-e96e7806d0f1 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:20.255625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08f04c-a5cc-4f0d-8fd2-e96e7806d0f1 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:20.255948 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08f04c-a5cc-4f0d-8fd2-e96e7806d0f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:20.257488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08f04c-a5cc-4f0d-8fd2-e96e7806d0f1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:20.261643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 387/773] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:22.364114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740373-caab-4ae6-86f9-665edfa8f4ed None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:22.364638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740373-caab-4ae6-86f9-665edfa8f4ed None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:22.364750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740373-caab-4ae6-86f9-665edfa8f4ed None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:22.366359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 387/774] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:22.371690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25070e-2811-43f4-b993-e619870ca55f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:22.372090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25070e-2811-43f4-b993-e619870ca55f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:22.372295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25070e-2811-43f4-b993-e619870ca55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:22.397193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-0b25070e-2811-43f4-b993-e619870ca55f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:22.398392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0b25070e-2811-43f4-b993-e619870ca55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:22.405594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 388/775] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:22 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:22.428622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51740373-caab-4ae6-86f9-665edfa8f4ed None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:22.440439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51740373-caab-4ae6-86f9-665edfa8f4ed None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:22.444437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445af5b-ca42-47bd-9893-acd16e337b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:22.445020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445af5b-ca42-47bd-9893-acd16e337b75 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:22.445311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445af5b-ca42-47bd-9893-acd16e337b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:22.445596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445af5b-ca42-47bd-9893-acd16e337b75 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:22.446280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445af5b-ca42-47bd-9893-acd16e337b75 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:22.447848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445af5b-ca42-47bd-9893-acd16e337b75 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:22.462438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 388/776] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:29:22 2022] POST /identity/v3/services => generated 251 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:29:24.563447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2296d9-19a2-4c92-a184-a8e19046b184 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:24.564017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2296d9-19a2-4c92-a184-a8e19046b184 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:24.564017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2296d9-19a2-4c92-a184-a8e19046b184 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:24.565695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 389/777] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:29:24.571047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a553b7-f901-4cf4-9081-d2da7f0767f3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:24.571465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a553b7-f901-4cf4-9081-d2da7f0767f3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:24.571633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a553b7-f901-4cf4-9081-d2da7f0767f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:24.594806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f3a553b7-f901-4cf4-9081-d2da7f0767f3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:24.595969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f3a553b7-f901-4cf4-9081-d2da7f0767f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:24.612812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 389/778] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:24 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:24.635021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2296d9-19a2-4c92-a184-a8e19046b184 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:24.647218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2296d9-19a2-4c92-a184-a8e19046b184 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:24.651186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:24.651920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:24.652234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:24.652518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:24.653141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:24.654704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:24.665448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 08 02:29:24.666465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 390/779] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:24.672271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a553b7-f901-4cf4-9081-d2da7f0767f3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:24.680942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a553b7-f901-4cf4-9081-d2da7f0767f3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:24.685108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:24.685686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:24.685979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:24.686266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:24.686944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:24.687274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:24.688931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:24.693447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 390/780] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:24.698596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:24.708038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07ed49-494c-4d6f-9fe7-1f87b5b4a7d0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:24.712113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:24.712670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:24.712957 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:24.713237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:24.713892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:24.714191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:24.715701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:24.720894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 391/781] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:24.726153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:24.735181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777cd8f-67a8-4511-b8c2-16b2fb53ca85 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:24.739255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a730cd-6c93-4987-b9ab-0a8b00ba5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:24.739817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a730cd-6c93-4987-b9ab-0a8b00ba5bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:24.740150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a730cd-6c93-4987-b9ab-0a8b00ba5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:24.740439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a730cd-6c93-4987-b9ab-0a8b00ba5bd8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:24.741173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a730cd-6c93-4987-b9ab-0a8b00ba5bd8 admin admin] RBAC: Adding query filter params (interface=public, service_id=9758659643f54c21ac7202ed0113f3b2, region_id=RegionOne) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:24.741483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a730cd-6c93-4987-b9ab-0a8b00ba5bd8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:24.743008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a730cd-6c93-4987-b9ab-0a8b00ba5bd8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:24.747903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 391/782] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:29:24 2022] GET /identity/v3/endpoints?service_id=9758659643f54c21ac7202ed0113f3b2&interface=public®ion_id=RegionOne => generated 194 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:24.753519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:24.762260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e6277-1123-4bc9-a635-71974775a7ec admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:24.767367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f357-3cbe-4362-b8e3-ae1aa535f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:24.767939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f357-3cbe-4362-b8e3-ae1aa535f29a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:24.768239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f357-3cbe-4362-b8e3-ae1aa535f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:24.768523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f357-3cbe-4362-b8e3-ae1aa535f29a admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:24.769159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f357-3cbe-4362-b8e3-ae1aa535f29a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:24.770681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f357-3cbe-4362-b8e3-ae1aa535f29a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:24.776602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 392/783] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:29:24 2022] GET /identity/v3/services => generated 1739 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:29:26.882931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85b0ad-9c9b-42c1-bc3f-68a2e7e36fc4 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:26.883449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85b0ad-9c9b-42c1-bc3f-68a2e7e36fc4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:26.883533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85b0ad-9c9b-42c1-bc3f-68a2e7e36fc4 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:26.885307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 392/784] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:26.890968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064e46c-da2c-4b16-8ce9-8e2430ea33d8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:26.891386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064e46c-da2c-4b16-8ce9-8e2430ea33d8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:26.891532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064e46c-da2c-4b16-8ce9-8e2430ea33d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:26.914618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9064e46c-da2c-4b16-8ce9-8e2430ea33d8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:26.915750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9064e46c-da2c-4b16-8ce9-8e2430ea33d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:26.922727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 393/785] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:26 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:26.944789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85b0ad-9c9b-42c1-bc3f-68a2e7e36fc4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:26.957516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85b0ad-9c9b-42c1-bc3f-68a2e7e36fc4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:26.961503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:26.962206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:26.962493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:26.962774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:26.963390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:26.964995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:26.976245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 08 02:29:26.977276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 393/786] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:26.982900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064e46c-da2c-4b16-8ce9-8e2430ea33d8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:26.991316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064e46c-da2c-4b16-8ce9-8e2430ea33d8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:26.995416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:26.996023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:26.996313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:26.996594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:26.997263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:26.997563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:26.999614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:27.004228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 394/787] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:27.009310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:27.018913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb1026-9ad9-4ffb-b1cb-953387af8a4d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:27.023026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e5bd7-ec0d-4dd8-af73-ee22a3ab17fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:27.023595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e5bd7-ec0d-4dd8-af73-ee22a3ab17fc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:27.023885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e5bd7-ec0d-4dd8-af73-ee22a3ab17fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:27.024202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e5bd7-ec0d-4dd8-af73-ee22a3ab17fc admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:27.024867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e5bd7-ec0d-4dd8-af73-ee22a3ab17fc admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:27.025171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e5bd7-ec0d-4dd8-af73-ee22a3ab17fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:27.026704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e5bd7-ec0d-4dd8-af73-ee22a3ab17fc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:27.031365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 394/788] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:27.036509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:27.045285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85410faf-143b-4196-a764-976b75ff95ec admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:27.051800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478f5c5-65b9-418f-aef9-bc7d7084b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:27.052415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f5c5-65b9-418f-aef9-bc7d7084b0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:27.053798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f5c5-65b9-418f-aef9-bc7d7084b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:27.054097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478f5c5-65b9-418f-aef9-bc7d7084b0f2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:27.054785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478f5c5-65b9-418f-aef9-bc7d7084b0f2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:27.056373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478f5c5-65b9-418f-aef9-bc7d7084b0f2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:27.074529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 395/789] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:29:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:29.170419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfee8c-9ae4-4809-a07e-9fc4ce2a1752 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:29.171457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfee8c-9ae4-4809-a07e-9fc4ce2a1752 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:29.171594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfee8c-9ae4-4809-a07e-9fc4ce2a1752 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:29.173448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 395/790] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:29.178946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e966-2903-452f-b2b6-70056d846c72 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:29.179378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e966-2903-452f-b2b6-70056d846c72 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:29.179521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e966-2903-452f-b2b6-70056d846c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:29.201738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8014e966-2903-452f-b2b6-70056d846c72 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:29.203057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8014e966-2903-452f-b2b6-70056d846c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:29.219806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 396/791] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:29 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:29.243696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfee8c-9ae4-4809-a07e-9fc4ce2a1752 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:29.256208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfee8c-9ae4-4809-a07e-9fc4ce2a1752 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:29.260230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:29.260807 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:29.261103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:29.261390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:29.262037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:29.263863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:29.265416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.common [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 08 02:29:29.283889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.sql.core [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 08 02:29:29.283889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 08 02:29:29.283889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [parameters: {'id': 'f9d55ee3ab5540ada026e3563b8e3b14', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 08 02:29:29.283889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66996) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 08 02:29:29.298108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9d55ee3ab5540ada026e3563b8e3b14.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9d55ee3ab5540ada026e3563b8e3b14. Apr 08 02:29:29.299316 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 396/792] 10.222.0.23 () {60 vars in 1161 bytes} [Fri Apr 8 02:29:29 2022] POST /identity/v3/projects => generated 262 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:29.305657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014e966-2903-452f-b2b6-70056d846c72 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:29.314416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014e966-2903-452f-b2b6-70056d846c72 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:29.318615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc79849-3ff6-41e8-a403-0673878e91ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:29.319323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc79849-3ff6-41e8-a403-0673878e91ef admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:29.319612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc79849-3ff6-41e8-a403-0673878e91ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:29.319893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc79849-3ff6-41e8-a403-0673878e91ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:29.327673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc79849-3ff6-41e8-a403-0673878e91ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:29.329627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc79849-3ff6-41e8-a403-0673878e91ef admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:29.343695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5dc79849-3ff6-41e8-a403-0673878e91ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:29.344760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 397/793] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:29.353483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:29.364730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571a0b-af66-4c72-af6b-91de96aad581 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:29.368984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be5ae85-8cb5-4668-917a-eb44dc209571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:29.369563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ae85-8cb5-4668-917a-eb44dc209571 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:29.369856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ae85-8cb5-4668-917a-eb44dc209571 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:29.370141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be5ae85-8cb5-4668-917a-eb44dc209571 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:29.370853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5ae85-8cb5-4668-917a-eb44dc209571 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:29.371150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5ae85-8cb5-4668-917a-eb44dc209571 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:29.373250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be5ae85-8cb5-4668-917a-eb44dc209571 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:29.391015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 397/794] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:31.572820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06222b-c761-4925-b78d-23d550eb5d5d None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.573369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06222b-c761-4925-b78d-23d550eb5d5d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.573369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06222b-c761-4925-b78d-23d550eb5d5d None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.575037 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 398/795] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:31.582018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fc786-73b5-4f81-812c-a22652e9f1d5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.582486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fc786-73b5-4f81-812c-a22652e9f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.582727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fc786-73b5-4f81-812c-a22652e9f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.610262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-768fc786-73b5-4f81-812c-a22652e9f1d5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:31.611777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-768fc786-73b5-4f81-812c-a22652e9f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:31.619068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 398/796] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:31 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:31.645041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06222b-c761-4925-b78d-23d550eb5d5d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.657222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06222b-c761-4925-b78d-23d550eb5d5d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.661881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.662465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.662758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.663036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.663677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.665526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:31.666858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.common [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 08 02:29:31.680536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.sql.core [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 08 02:29:31.680536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 08 02:29:31.680536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [parameters: {'user_id': 'a3868e9e80314cce8593fc0464d92e75', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 08 02:29:31.680536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66995) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 08 02:29:31.698380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 08 02:29:31.699647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 399/797] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:29:31 2022] POST /identity/v3/users => generated 160 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:31.706188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fc786-73b5-4f81-812c-a22652e9f1d5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.716689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fc786-73b5-4f81-812c-a22652e9f1d5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.722054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf522827-30f3-4f45-a442-1723b54378aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.722776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522827-30f3-4f45-a442-1723b54378aa admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.723071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522827-30f3-4f45-a442-1723b54378aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.723361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522827-30f3-4f45-a442-1723b54378aa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.736370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf522827-30f3-4f45-a442-1723b54378aa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.738333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf522827-30f3-4f45-a442-1723b54378aa admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:31.760312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-cf522827-30f3-4f45-a442-1723b54378aa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 08 02:29:31.762113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 399/798] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:31.768875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:31.783279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180078f5-1ca4-41b1-b1a6-a1a8cf7eaf77 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:31.787608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb0557-9d1e-46de-a0bc-ed8203935b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:31.788231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0557-9d1e-46de-a0bc-ed8203935b00 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:31.788521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0557-9d1e-46de-a0bc-ed8203935b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:31.788806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0557-9d1e-46de-a0bc-ed8203935b00 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:31.789572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb0557-9d1e-46de-a0bc-ed8203935b00 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:31.789880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb0557-9d1e-46de-a0bc-ed8203935b00 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:31.791985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb0557-9d1e-46de-a0bc-ed8203935b00 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:31.824137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 400/799] 10.222.0.23 () {56 vars in 1122 bytes} [Fri Apr 8 02:29:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:34.154359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820542-8a9e-407c-b157-204ee6e63fc7 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:34.154954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820542-8a9e-407c-b157-204ee6e63fc7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:34.154954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1820542-8a9e-407c-b157-204ee6e63fc7 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:34.156759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 400/800] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:34.161917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74c58-3053-4180-96e3-5ba1e91f787e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:34.162361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74c58-3053-4180-96e3-5ba1e91f787e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:34.162493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74c58-3053-4180-96e3-5ba1e91f787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:34.185168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-84e74c58-3053-4180-96e3-5ba1e91f787e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:34.187228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-84e74c58-3053-4180-96e3-5ba1e91f787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:34.194248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 401/801] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:34 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:34.219004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820542-8a9e-407c-b157-204ee6e63fc7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:34.230598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1820542-8a9e-407c-b157-204ee6e63fc7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:34.235358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:34.236089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:34.236379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:34.236658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:34.247960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:34.250541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:34.266844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:34.267920 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 401/802] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:34.273975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74c58-3053-4180-96e3-5ba1e91f787e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:34.282853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74c58-3053-4180-96e3-5ba1e91f787e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:34.287076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01416f-9670-4a11-aceb-3c76fcce3856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:34.287847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01416f-9670-4a11-aceb-3c76fcce3856 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:34.288176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01416f-9670-4a11-aceb-3c76fcce3856 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:34.288462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01416f-9670-4a11-aceb-3c76fcce3856 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:34.289155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01416f-9670-4a11-aceb-3c76fcce3856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:34.289465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01416f-9670-4a11-aceb-3c76fcce3856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:34.291051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01416f-9670-4a11-aceb-3c76fcce3856 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:34.304137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 402/803] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:34.309674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:34.319463 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331265d-37fa-4ca8-bb8c-a88454256e67 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:34.323677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d5802-32d9-4e6e-be16-a24dd24cbde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:34.324296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5802-32d9-4e6e-be16-a24dd24cbde0 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:34.324588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5802-32d9-4e6e-be16-a24dd24cbde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:34.324871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d5802-32d9-4e6e-be16-a24dd24cbde0 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:34.325520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d5802-32d9-4e6e-be16-a24dd24cbde0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:34.327394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d5802-32d9-4e6e-be16-a24dd24cbde0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:34.346733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 402/804] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:29:34 2022] POST /identity/v3/users => generated 249 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:29:36.465438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bee2-5521-4589-a3b8-7baef4298427 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.465984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bee2-5521-4589-a3b8-7baef4298427 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.465984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707bee2-5521-4589-a3b8-7baef4298427 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.467789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 403/805] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:36.472986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b285f2-8d10-4f78-bc84-de88ddb3d4af None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.473396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b285f2-8d10-4f78-bc84-de88ddb3d4af None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.473560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b285f2-8d10-4f78-bc84-de88ddb3d4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.495549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b5b285f2-8d10-4f78-bc84-de88ddb3d4af None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:36.496725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b5b285f2-8d10-4f78-bc84-de88ddb3d4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:36.504482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 403/806] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:36 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:36.527657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bee2-5521-4589-a3b8-7baef4298427 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.539331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707bee2-5521-4589-a3b8-7baef4298427 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.543335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.544071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.544362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.544645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.556248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:29:36.563619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:36.564715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 404/807] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.570498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b285f2-8d10-4f78-bc84-de88ddb3d4af None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.579145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b285f2-8d10-4f78-bc84-de88ddb3d4af None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.583336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.583920 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.584241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.584530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.585244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:36.585546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.587110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.595329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 404/808] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:36.600539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.610490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c31df5-b105-4347-a32c-897c661e8533 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.614612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.615292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.615582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.615866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.627697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.629527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.646182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:36.647210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 405/809] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.652536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.661891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698279e3-8f58-46b7-b721-25390d7b728b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.666135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.666740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.667035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.667324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.668041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:36.668346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.669892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.682644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 405/810] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:36.688362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.697254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e9dd1-825d-472f-96f2-75e4b6bd10f1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.701358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.702075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.702363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.702638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.714902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.717135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.735277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 08 02:29:36.736447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 406/811] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.742692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.756861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ec54a-e382-4a42-9674-fbeb089175a4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.761059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.761646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.761937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.762221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.763003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:36.763306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.765380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.793981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 406/812] 10.222.0.23 () {56 vars in 1160 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:36.800572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.810034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6164f8-3cad-4e21-9cc1-79a3e16268b2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.814169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.814733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.815020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.815300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.822747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.824507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.833319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 407/813] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:36.838694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.848439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50192f4-6ce9-4817-ac6b-38a62a4808eb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.852672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.853380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.853675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.853995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.865943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.867843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.884264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:36.885313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 407/814] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.890897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.899329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d9615-dabf-4811-bcee-574985786354 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.904289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.905397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.905682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.907708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.908435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:36.908744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.910315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.924282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 408/815] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:36.930357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.940016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c382-09a7-464b-9eb2-943162e4d241 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.944203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.944918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.945211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.945495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.954398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.956396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:36.971114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:36.975964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 408/816] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:36.978155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:36.988557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7c9d9-96d2-4955-bbd4-41ee44799e97 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:36.992811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c94f75-8317-4e50-830b-25ecf5530463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:36.993399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c94f75-8317-4e50-830b-25ecf5530463 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:36.993696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c94f75-8317-4e50-830b-25ecf5530463 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:36.993975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c94f75-8317-4e50-830b-25ecf5530463 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:36.994720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c94f75-8317-4e50-830b-25ecf5530463 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:36.995022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c94f75-8317-4e50-830b-25ecf5530463 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:36.996871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c94f75-8317-4e50-830b-25ecf5530463 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:37.011283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 409/817] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:37.017440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:37.026995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5dce1-8505-4577-8c30-72cb1e66f6cd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:37.032273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363966e-507c-43d0-a817-6ea093d2bbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:37.033219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363966e-507c-43d0-a817-6ea093d2bbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:37.033703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363966e-507c-43d0-a817-6ea093d2bbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:37.034147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363966e-507c-43d0-a817-6ea093d2bbc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:37.035396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363966e-507c-43d0-a817-6ea093d2bbc8 admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=865abd5c9d3b454ca1011e6e3111f580) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:37.035885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363966e-507c-43d0-a817-6ea093d2bbc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:37.038923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363966e-507c-43d0-a817-6ea093d2bbc8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:37.048571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 409/818] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:37 2022] GET /identity/v3/role_assignments?user.id=865abd5c9d3b454ca1011e6e3111f580&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:39.138250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad35b6-e960-4637-8911-c9bc1a76a1dc None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.138775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad35b6-e960-4637-8911-c9bc1a76a1dc None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.138902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad35b6-e960-4637-8911-c9bc1a76a1dc None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.141242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 410/819] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:39.146398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a162ef-b5b2-44d0-8630-49f2793b9727 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.146812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a162ef-b5b2-44d0-8630-49f2793b9727 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.146976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a162ef-b5b2-44d0-8630-49f2793b9727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.170113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a8a162ef-b5b2-44d0-8630-49f2793b9727 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:39.171362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a8a162ef-b5b2-44d0-8630-49f2793b9727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:39.178529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 410/820] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:39 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:39.201138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad35b6-e960-4637-8911-c9bc1a76a1dc None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.213654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad35b6-e960-4637-8911-c9bc1a76a1dc None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.217874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.218434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.218727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.219013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.229936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:29:39.236324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:39.237385 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 411/821] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:39.242940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a162ef-b5b2-44d0-8630-49f2793b9727 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.251837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a162ef-b5b2-44d0-8630-49f2793b9727 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.256010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.256595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.256889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.257177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.257887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:39.258192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.259773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.268091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 411/822] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:39.273406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.283867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503d784-6132-4266-865f-57d071d8494c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.288115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.288807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.289097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.289380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.301080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.303130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.319821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:39.320896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 412/823] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:39.326606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.336166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c499d-f0da-4714-bb34-3e3e0a60b3a0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.340336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.340910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.341203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.341489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.342171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:39.343458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.345056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.359163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 412/824] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:39.364559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.373667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5796dec-ca9b-4fee-acdc-09f3094fd242 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.378215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.378929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.379221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.379506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.392692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.394612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.412573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 08 02:29:39.413618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 413/825] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:39.419099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.428610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffdc01-ceb7-4e41-a224-c6b555c98f0c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.432799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.433379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.433672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.433956 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.434735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:39.435038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.436889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.465210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 413/826] 10.222.0.23 () {56 vars in 1160 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:39.471356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.480704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d691eea-c2d3-42d5-b233-6657f64d0a2c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.485164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.485869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.486162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.486448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.498025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.500148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.517343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:39.518404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 414/827] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:39.523952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.533764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb7d9c-7449-4c9e-92ad-103e6572743c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.537946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.538524 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.538819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.539107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.539796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:39.540142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.541712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.554008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 414/828] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:39.559202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.568510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d28ce2-967c-44b7-94a5-6be14afe1ec7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.572746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.573444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.573732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.574019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.582896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.584850 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.598703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:39.599734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 415/829] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:39.605123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.614289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ae7bc-f2e8-4c37-a102-4a5b4f2c28d3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.618472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f94f0-d2fd-49ff-ab2a-4b8e888475d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.619048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f94f0-d2fd-49ff-ab2a-4b8e888475d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.619344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f94f0-d2fd-49ff-ab2a-4b8e888475d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.619636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f94f0-d2fd-49ff-ab2a-4b8e888475d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.620414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f94f0-d2fd-49ff-ab2a-4b8e888475d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:39.620727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f94f0-d2fd-49ff-ab2a-4b8e888475d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.622527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f94f0-d2fd-49ff-ab2a-4b8e888475d2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.635415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 415/830] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:39.641459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:39.650516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04a292-9c4f-4133-b4e7-d3c17b44acc4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:39.654621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd335925-154a-49e7-b702-6047206d38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:39.655598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd335925-154a-49e7-b702-6047206d38cd admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:39.655891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd335925-154a-49e7-b702-6047206d38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:39.656217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd335925-154a-49e7-b702-6047206d38cd admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/865abd5c9d3b454ca1011e6e3111f580/roles/58f38def815542948bd51acfd4644ea3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:39.676070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd335925-154a-49e7-b702-6047206d38cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=865abd5c9d3b454ca1011e6e3111f580, role_id=58f38def815542948bd51acfd4644ea3)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:39.678918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd335925-154a-49e7-b702-6047206d38cd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:39.691596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 416/831] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:29:39 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/865abd5c9d3b454ca1011e6e3111f580/roles/58f38def815542948bd51acfd4644ea3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:29:41.774769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1732b-8d62-4e8e-a451-927152fed1f8 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.775258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1732b-8d62-4e8e-a451-927152fed1f8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.775258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1732b-8d62-4e8e-a451-927152fed1f8 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.776966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 416/832] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:41.783259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346cbd2-f36e-412f-8a40-62a49dc5fc49 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.783677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346cbd2-f36e-412f-8a40-62a49dc5fc49 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.783849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346cbd2-f36e-412f-8a40-62a49dc5fc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.805669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1346cbd2-f36e-412f-8a40-62a49dc5fc49 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:41.806828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1346cbd2-f36e-412f-8a40-62a49dc5fc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:41.869908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 417/833] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:41 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:41.893655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1732b-8d62-4e8e-a451-927152fed1f8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.905815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1732b-8d62-4e8e-a451-927152fed1f8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.909838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.910546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.910838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.911127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.922114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:29:41.928797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:41.929865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 417/834] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:41.935545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346cbd2-f36e-412f-8a40-62a49dc5fc49 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.944268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346cbd2-f36e-412f-8a40-62a49dc5fc49 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.948469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.949059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.949351 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.949641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.950365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:41.950673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:41.952908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:41.961140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 418/835] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:41.966361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:41.976777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e2773-981b-4d4f-8157-29d551d49837 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:41.980966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:41.981657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:41.981951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:41.982238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:41.993087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:41.994881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.012160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:42.013198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 418/836] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:42.019993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.029114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668e054-a33f-4510-aef5-ca6e9447f951 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.033344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.033921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.034221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.034512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.035199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:42.035504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.037104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.049336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 419/837] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:42.054631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.064200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef2ed8-1b7a-44bb-8aba-04f82646aea9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.068425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.069120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.069413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.069695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.082593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.084624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.102039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 08 02:29:42.103074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 419/838] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:42.108440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.117531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79691520-8957-48b5-b10c-ce84a1363624 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.121756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.122338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.122632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.122919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.124225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:42.124530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.126336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.156178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 420/839] 10.222.0.23 () {56 vars in 1160 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:42.161523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.170742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eddf7a-8d6f-477d-90e6-84e823628b08 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.174849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.175406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.175699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.176021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.183780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.185551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.195387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 420/840] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:42.201016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.210790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede37de-80ee-476a-bd17-e6a6a426bbb6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.214983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.215690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.216014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.216306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.227705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.229574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.246003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:42.247048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 421/841] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:42.253025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.261366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064c5f8-6116-4c0c-95ed-8f59e6fb2dd1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.266206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.266778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.267069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.267353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.268070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:42.268376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.269932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.282048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 421/842] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:42.287040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.296251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ce9f2-eb12-46f9-bd6f-f111055771c0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.300419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.301109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.301652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.301940 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.310191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.312635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.325922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:42.327055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 422/843] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:42.332657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.342081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09d39c-af42-480b-91eb-6e0c19ac8a22 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.346860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f4902-1948-4c5d-be1c-3354f42179f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.347438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4902-1948-4c5d-be1c-3354f42179f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.347732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4902-1948-4c5d-be1c-3354f42179f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.348054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f4902-1948-4c5d-be1c-3354f42179f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.348800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f4902-1948-4c5d-be1c-3354f42179f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:42.349111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f4902-1948-4c5d-be1c-3354f42179f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.350937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f4902-1948-4c5d-be1c-3354f42179f7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.363988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 422/844] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:42.369485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:42.378726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c6e4a-7ff8-4bd7-a409-c3346896ec00 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:42.383581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d1c5f-ff14-4aa4-826a-2f3c6326e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:42.384189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d1c5f-ff14-4aa4-826a-2f3c6326e3eb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:42.384487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d1c5f-ff14-4aa4-826a-2f3c6326e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:42.384775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d1c5f-ff14-4aa4-826a-2f3c6326e3eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:42.385570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d1c5f-ff14-4aa4-826a-2f3c6326e3eb admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=865abd5c9d3b454ca1011e6e3111f580) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:42.385878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d1c5f-ff14-4aa4-826a-2f3c6326e3eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:42.387691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d1c5f-ff14-4aa4-826a-2f3c6326e3eb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:42.394116 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 423/845] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:42 2022] GET /identity/v3/role_assignments?user.id=865abd5c9d3b454ca1011e6e3111f580&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:44.517688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94df1f-994e-4572-84dc-47c9108b86a6 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.518192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94df1f-994e-4572-84dc-47c9108b86a6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.518274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94df1f-994e-4572-84dc-47c9108b86a6 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.519949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 423/846] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:44.525053 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e26d-4474-44d8-9c08-446e69e5347c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.525423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e26d-4474-44d8-9c08-446e69e5347c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.525623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37e26d-4474-44d8-9c08-446e69e5347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.548356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2f37e26d-4474-44d8-9c08-446e69e5347c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:44.549497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2f37e26d-4474-44d8-9c08-446e69e5347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:44.556515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 424/847] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:44 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:44.578283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94df1f-994e-4572-84dc-47c9108b86a6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:44.589916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94df1f-994e-4572-84dc-47c9108b86a6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:44.594700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:44.595404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.595696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.596008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] PATH_INFO: `/v3/services/network` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.596634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:44.598208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:44.609257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 08 02:29:44.610306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 424/848] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:44 2022] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:44.615761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e26d-4474-44d8-9c08-446e69e5347c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:44.624160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37e26d-4474-44d8-9c08-446e69e5347c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:44.628526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90633a9e-97b5-4ca8-9d3d-9abdea9c6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:44.629115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633a9e-97b5-4ca8-9d3d-9abdea9c6a42 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.629405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633a9e-97b5-4ca8-9d3d-9abdea9c6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.629690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90633a9e-97b5-4ca8-9d3d-9abdea9c6a42 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.630373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90633a9e-97b5-4ca8-9d3d-9abdea9c6a42 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:44.630677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90633a9e-97b5-4ca8-9d3d-9abdea9c6a42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:44.632294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90633a9e-97b5-4ca8-9d3d-9abdea9c6a42 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:44.637050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 425/849] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:44.642774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:44.651695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7e06b-e55c-49b5-8561-9815a0f7799e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:44.656996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a14623-ad72-4547-bdf3-3b8b4afd2b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:44.657563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a14623-ad72-4547-bdf3-3b8b4afd2b8f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:44.657853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a14623-ad72-4547-bdf3-3b8b4afd2b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:44.658138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a14623-ad72-4547-bdf3-3b8b4afd2b8f admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:44.658800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a14623-ad72-4547-bdf3-3b8b4afd2b8f admin admin] RBAC: Adding query filter params (type=network) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:44.659102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a14623-ad72-4547-bdf3-3b8b4afd2b8f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:44.660685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a14623-ad72-4547-bdf3-3b8b4afd2b8f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:44.664929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 425/850] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:46.738741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bf432-20d7-4a1b-a848-b252be702d95 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.739237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bf432-20d7-4a1b-a848-b252be702d95 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.739237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bf432-20d7-4a1b-a848-b252be702d95 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.740938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 426/851] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:46.746048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02ff9-cebd-4318-8a29-ed690cd71c75 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.746458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02ff9-cebd-4318-8a29-ed690cd71c75 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.746616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02ff9-cebd-4318-8a29-ed690cd71c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.770848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-50e02ff9-cebd-4318-8a29-ed690cd71c75 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:46.772047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-50e02ff9-cebd-4318-8a29-ed690cd71c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:46.781397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 426/852] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:46 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:46.804308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bf432-20d7-4a1b-a848-b252be702d95 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:46.816785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bf432-20d7-4a1b-a848-b252be702d95 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:46.820798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bbc2a-b56d-4073-be3a-cf3b76c6b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:46.821369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bbc2a-b56d-4073-be3a-cf3b76c6b384 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:46.821655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bbc2a-b56d-4073-be3a-cf3b76c6b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:46.821936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bbc2a-b56d-4073-be3a-cf3b76c6b384 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:46.822610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bbc2a-b56d-4073-be3a-cf3b76c6b384 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:46.824203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bbc2a-b56d-4073-be3a-cf3b76c6b384 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:46.837562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 427/853] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:29:46 2022] POST /identity/v3/services => generated 240 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:29:48.939249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd475908-eb92-4107-b0f3-6ec038a73521 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:48.939801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd475908-eb92-4107-b0f3-6ec038a73521 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:48.939898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd475908-eb92-4107-b0f3-6ec038a73521 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:48.941525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 427/854] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:48.946761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a858cf-513d-4505-8f04-f1ce86327204 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:48.947124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a858cf-513d-4505-8f04-f1ce86327204 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:48.947338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a858cf-513d-4505-8f04-f1ce86327204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:48.969556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-96a858cf-513d-4505-8f04-f1ce86327204 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:48.970703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-96a858cf-513d-4505-8f04-f1ce86327204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:48.987640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 428/855] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:48 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:49.010069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd475908-eb92-4107-b0f3-6ec038a73521 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.021678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd475908-eb92-4107-b0f3-6ec038a73521 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.025726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.026433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.026726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.027014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.027639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.029249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:49.039965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 08 02:29:49.041009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 428/856] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/services/network => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:49.047197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a858cf-513d-4505-8f04-f1ce86327204 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.056070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a858cf-513d-4505-8f04-f1ce86327204 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.060290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.060872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.061168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.061457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.062161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:49.062466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.064072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:49.068772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 429/857] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.074093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.083701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0a767-f46b-4f6d-96f1-e2f2088bfd55 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.087831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.088427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.088719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.089004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.089666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] RBAC: Adding query filter params (type=network) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:49.089966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.091488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:49.097117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 429/858] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.102431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.111743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f43a7-80a2-49e0-ba55-e4b1d9e097a4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.116466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7074-8cee-4cb1-a631-eae7490195f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.117029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7074-8cee-4cb1-a631-eae7490195f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.117321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7074-8cee-4cb1-a631-eae7490195f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.117605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7074-8cee-4cb1-a631-eae7490195f7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.118342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7074-8cee-4cb1-a631-eae7490195f7 admin admin] RBAC: Adding query filter params (interface=public, service_id=f77d380f67b64f87a79ff5bb2c29a645, region_id=RegionOne) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:49.118646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7074-8cee-4cb1-a631-eae7490195f7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.120220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7074-8cee-4cb1-a631-eae7490195f7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:49.125489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 430/859] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/endpoints?service_id=f77d380f67b64f87a79ff5bb2c29a645&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:49.131755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:49.141928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f6abd-c168-45c6-81c4-6bc84a7dbc3f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:49.146149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47ba98-f69b-41f9-8775-7387b13ee9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:49.146726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ba98-f69b-41f9-8775-7387b13ee9ec admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:49.147017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ba98-f69b-41f9-8775-7387b13ee9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:49.147302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ba98-f69b-41f9-8775-7387b13ee9ec admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:49.147972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47ba98-f69b-41f9-8775-7387b13ee9ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:49.149530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47ba98-f69b-41f9-8775-7387b13ee9ec admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:49.155761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 430/860] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:29:49 2022] GET /identity/v3/services => generated 1967 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:29:51.258393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132556-281d-437c-9e46-cd698a1a91d7 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:51.258917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132556-281d-437c-9e46-cd698a1a91d7 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:51.259001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132556-281d-437c-9e46-cd698a1a91d7 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:51.260677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 431/861] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:51.266327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7000ef9-0a63-422e-bb14-3d1e9c339dea None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:51.266746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7000ef9-0a63-422e-bb14-3d1e9c339dea None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:51.266908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7000ef9-0a63-422e-bb14-3d1e9c339dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:51.290478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e7000ef9-0a63-422e-bb14-3d1e9c339dea None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:51.291616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e7000ef9-0a63-422e-bb14-3d1e9c339dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:51.299360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 431/862] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:51 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:51.322157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132556-281d-437c-9e46-cd698a1a91d7 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:51.334442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132556-281d-437c-9e46-cd698a1a91d7 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:51.338434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:51.339134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:51.339421 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:51.339700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:51.340339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:51.341893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:51.352873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 08 02:29:51.353904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 432/863] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:51 2022] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:51.359583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7000ef9-0a63-422e-bb14-3d1e9c339dea None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:51.367948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7000ef9-0a63-422e-bb14-3d1e9c339dea None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:51.372183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:51.372761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:51.373053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:51.373339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:51.374011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:51.374315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:51.376114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:51.380767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 432/864] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:51.385994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:51.395816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fac9-6a2d-49b6-9380-d770ba1174d9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:51.399983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117f05c-e5db-43f9-b53a-a637953132dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:51.400543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117f05c-e5db-43f9-b53a-a637953132dc admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:51.400829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117f05c-e5db-43f9-b53a-a637953132dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:51.401111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117f05c-e5db-43f9-b53a-a637953132dc admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:51.401768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117f05c-e5db-43f9-b53a-a637953132dc admin admin] RBAC: Adding query filter params (type=network) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:51.402091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117f05c-e5db-43f9-b53a-a637953132dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:51.403649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117f05c-e5db-43f9-b53a-a637953132dc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:51.409190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 433/865] 10.222.0.23 () {56 vars in 1133 bytes} [Fri Apr 8 02:29:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:51.415255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:51.425485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45b3f5-6f5a-4bff-9673-fd5c854eb246 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:51.431226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a1ea-1326-4a73-83e4-7e790ea38a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:51.432159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a1ea-1326-4a73-83e4-7e790ea38a1e admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:51.432458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a1ea-1326-4a73-83e4-7e790ea38a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:51.432747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a1ea-1326-4a73-83e4-7e790ea38a1e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:51.433449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a1ea-1326-4a73-83e4-7e790ea38a1e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:51.435036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a1ea-1326-4a73-83e4-7e790ea38a1e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:51.453419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 433/866] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:29:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:29:53.721377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55084296-eeca-40fe-8ae4-cbf757b4e8fc None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:53.721890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55084296-eeca-40fe-8ae4-cbf757b4e8fc None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:53.721972 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55084296-eeca-40fe-8ae4-cbf757b4e8fc None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:53.723610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 434/867] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:53.728966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe82fc-76a6-47a1-a867-74f9aece67b5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:53.729373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe82fc-76a6-47a1-a867-74f9aece67b5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:53.729542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe82fc-76a6-47a1-a867-74f9aece67b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:53.752266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c4fe82fc-76a6-47a1-a867-74f9aece67b5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:53.753340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c4fe82fc-76a6-47a1-a867-74f9aece67b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:53.770984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 434/868] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:53.793212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55084296-eeca-40fe-8ae4-cbf757b4e8fc None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:53.805968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55084296-eeca-40fe-8ae4-cbf757b4e8fc None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:53.810050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:53.810623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:53.810910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:53.811193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:53.811945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:53.814332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:53.820087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.sql.core [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 08 02:29:53.820087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 08 02:29:53.820087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [parameters: {'id': 'ad25e136b6884f8fabec4034f449242f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 08 02:29:53.820087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66995) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Apr 08 02:29:53.825491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 08 02:29:53.826581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 435/869] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:29:53 2022] POST /identity/v3/roles => generated 144 bytes in 34 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:53.832707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe82fc-76a6-47a1-a867-74f9aece67b5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:53.841330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe82fc-76a6-47a1-a867-74f9aece67b5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:53.845650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37b44b-4755-40f0-ae60-6c3bb64e88f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:53.846372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b44b-4755-40f0-ae60-6c3bb64e88f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:53.846662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b44b-4755-40f0-ae60-6c3bb64e88f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:53.846948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b44b-4755-40f0-ae60-6c3bb64e88f7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:53.857815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37b44b-4755-40f0-ae60-6c3bb64e88f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:29:53.865065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-3a37b44b-4755-40f0-ae60-6c3bb64e88f7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 08 02:29:53.866128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 435/870] 10.222.0.23 () {56 vars in 1135 bytes} [Fri Apr 8 02:29:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:53.871471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:53.881485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44bfa7-d3cd-47a2-bf68-6977562d607b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:53.885699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee3e61-ff3c-4e98-b368-370dff33ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:53.886274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3e61-ff3c-4e98-b368-370dff33ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:53.886565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3e61-ff3c-4e98-b368-370dff33ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:53.886852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee3e61-ff3c-4e98-b368-370dff33ed48 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:53.887567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3e61-ff3c-4e98-b368-370dff33ed48 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:53.887868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3e61-ff3c-4e98-b368-370dff33ed48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:53.889459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee3e61-ff3c-4e98-b368-370dff33ed48 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:53.897722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 436/871] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:55.990044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feab243-605c-42c6-8498-49d02b48ab44 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.990576 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feab243-605c-42c6-8498-49d02b48ab44 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.990681 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feab243-605c-42c6-8498-49d02b48ab44 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:55.992320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 436/872] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:55.997446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cd2b-a115-456f-a234-a0894eff7789 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:55.997834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cd2b-a115-456f-a234-a0894eff7789 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:55.998027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8cd2b-a115-456f-a234-a0894eff7789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:56.020180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-92e8cd2b-a115-456f-a234-a0894eff7789 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:56.021320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-92e8cd2b-a115-456f-a234-a0894eff7789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:56.028217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 437/873] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:29:56.052639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feab243-605c-42c6-8498-49d02b48ab44 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:56.064920 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feab243-605c-42c6-8498-49d02b48ab44 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:56.069005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:56.069705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:56.069997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:56.070282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:56.081649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:56.083460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:56.101040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:56.102111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 437/874] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:56.107940 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8cd2b-a115-456f-a234-a0894eff7789 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:56.116898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8cd2b-a115-456f-a234-a0894eff7789 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:56.121080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e2814-b687-4df6-ad0b-a616f5583ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:56.121655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e2814-b687-4df6-ad0b-a616f5583ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:56.121942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e2814-b687-4df6-ad0b-a616f5583ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:56.122226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e2814-b687-4df6-ad0b-a616f5583ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:56.122919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e2814-b687-4df6-ad0b-a616f5583ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:56.123221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e2814-b687-4df6-ad0b-a616f5583ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:56.125220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e2814-b687-4df6-ad0b-a616f5583ce6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:56.143232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 438/875] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:56.149167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:56.158943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b986d89-0775-4bdb-948b-4ff572014d48 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:56.163083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff2d5-c34e-4df2-9416-62c724de9a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:56.163664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff2d5-c34e-4df2-9416-62c724de9a94 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:56.163980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff2d5-c34e-4df2-9416-62c724de9a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:56.164266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff2d5-c34e-4df2-9416-62c724de9a94 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:56.164913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff2d5-c34e-4df2-9416-62c724de9a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:56.166789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dff2d5-c34e-4df2-9416-62c724de9a94 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:56.186361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 438/876] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:29:56 2022] POST /identity/v3/users => generated 247 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:29:58.290497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6451bf-0093-4170-96a4-562cdbf79880 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.291022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6451bf-0093-4170-96a4-562cdbf79880 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.291109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6451bf-0093-4170-96a4-562cdbf79880 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.292810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 439/877] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:29:58.298417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9fc-a66c-4f5b-9f16-a0762638c05e None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.298832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9fc-a66c-4f5b-9f16-a0762638c05e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.298991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285c9fc-a66c-4f5b-9f16-a0762638c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.321603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3285c9fc-a66c-4f5b-9f16-a0762638c05e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:29:58.322740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3285c9fc-a66c-4f5b-9f16-a0762638c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:29:58.329840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 439/878] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:29:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:29:58.352491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6451bf-0093-4170-96a4-562cdbf79880 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.364721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6451bf-0093-4170-96a4-562cdbf79880 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.368770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.369470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.369760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.370040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.382474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:29:58.388825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:29:58.390214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 440/879] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:58.396051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9fc-a66c-4f5b-9f16-a0762638c05e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.404612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285c9fc-a66c-4f5b-9f16-a0762638c05e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.408862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.409445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.409737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.410024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.410737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:58.411041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.412657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.420801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 440/880] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:58.426737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.436162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c41d7-3d07-4f9d-8978-30dd6f0f3bfb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.440956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.441648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.441938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.442219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.453666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.455475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.473014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:58.474095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 441/881] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:58.479607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.489538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6816ef9-819b-45f5-b5ae-cf38dc88257f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.493792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.494372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.494665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.494949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.495632 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:58.495952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.497548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.509535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 441/882] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:58.514996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.524192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac322-3f75-48fd-8e99-ae1774a19e9b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.528332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.529027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.529314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.529595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.542422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.544374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.562353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:29:58.563374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 442/883] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:58.568774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.577950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619eca9-3ab4-4d4f-8df4-7513f15c3dab admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.582250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.582837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.583132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.583420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.584248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:58.584556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.586384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.615170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 442/884] 10.222.0.23 () {56 vars in 1156 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:29:58.620794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.630332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0275e65-10b8-4375-b5ed-a3769fea4e6a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.634443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.635001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.635285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.635565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.643456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.645195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.653867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 443/885] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:29:58.659932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.668942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce228ff-79c6-4297-a7f1-7b03fd99cb12 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.673904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.674605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.674898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.675182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.686634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.688469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.704688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:29:58.705724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 443/886] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:29:58.711076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.720034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff95b4-1658-4d16-a4dd-e063fe47ce03 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.724267 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.724840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.725129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.725413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.726090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:58.726390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.727951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.740291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 444/887] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:58.745354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.754582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac0655-79fa-4195-977f-21b923a89bd4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.758762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.759439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.759732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.760054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.768859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.770798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.784677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:29:58.785722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 444/888] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:29:58.791356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.801570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0058-fe96-44f0-9f77-a22d5dd4e1cd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.805703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585efa8-66b8-4fbe-976d-71fa8b4a587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.806275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efa8-66b8-4fbe-976d-71fa8b4a587f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.806566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efa8-66b8-4fbe-976d-71fa8b4a587f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.806851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585efa8-66b8-4fbe-976d-71fa8b4a587f admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.807590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585efa8-66b8-4fbe-976d-71fa8b4a587f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:58.807892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585efa8-66b8-4fbe-976d-71fa8b4a587f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.809711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585efa8-66b8-4fbe-976d-71fa8b4a587f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.823360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 445/889] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:29:58.829849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:29:58.839394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315adfb-840d-430f-9256-0c781f4ee0fb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:29:58.844291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89179dd-d268-4a92-af78-dbd8ff6bab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:29:58.844862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89179dd-d268-4a92-af78-dbd8ff6bab54 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:29:58.845156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89179dd-d268-4a92-af78-dbd8ff6bab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:29:58.845443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89179dd-d268-4a92-af78-dbd8ff6bab54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:29:58.846217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89179dd-d268-4a92-af78-dbd8ff6bab54 admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=7dcb623e589c4b17a7a9b3b022c51f96) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:29:58.846525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89179dd-d268-4a92-af78-dbd8ff6bab54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:29:58.848395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89179dd-d268-4a92-af78-dbd8ff6bab54 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:29:58.853535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 445/890] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:29:58 2022] GET /identity/v3/role_assignments?user.id=7dcb623e589c4b17a7a9b3b022c51f96&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:00.976015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b24c-29d5-4519-8bfd-898c6effdb5d None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.976565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b24c-29d5-4519-8bfd-898c6effdb5d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.976565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b24c-29d5-4519-8bfd-898c6effdb5d None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:00.978244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 446/891] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:00.983347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464adb-a45c-4215-ac9a-6062b928ed64 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:00.983798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464adb-a45c-4215-ac9a-6062b928ed64 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:00.983973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21464adb-a45c-4215-ac9a-6062b928ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.007075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-21464adb-a45c-4215-ac9a-6062b928ed64 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:01.008238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-21464adb-a45c-4215-ac9a-6062b928ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:01.015458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 446/892] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:01.038452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868b24c-29d5-4519-8bfd-898c6effdb5d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.050794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868b24c-29d5-4519-8bfd-898c6effdb5d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.055040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.055740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.056063 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.056344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.067479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:01.073796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:30:01.074869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 447/893] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:01.081230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21464adb-a45c-4215-ac9a-6062b928ed64 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.089522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21464adb-a45c-4215-ac9a-6062b928ed64 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.094635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.095209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.095498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.095778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.096517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:01.096815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.098360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.106367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 447/894] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:01.111765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.121230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ba801-ef28-480a-8f87-f96fd24a03bb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.125377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.126059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.126347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.126630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.137466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.139289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.157150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:01.158188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 448/895] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:01.163550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.173027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf105c-0fb7-4dba-9cda-b2c0bf067cbc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.177489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.178052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.178340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.178623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.179297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:01.179594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.181162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.193701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 448/896] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:01.199348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.209359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bc23c-6c7b-4378-8ca4-01dacddc8f00 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.213516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.214212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.214503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.214784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.227668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.229623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.246766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:30:01.247807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 449/897] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:01.253451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.262549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da054b95-9937-4884-92dc-cc4ad1061d7e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.267824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.268437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.268727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.269024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.269795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:01.270095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.271895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.302198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 449/898] 10.222.0.23 () {56 vars in 1156 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:01.307575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.316826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bcd51-43ad-43e1-999d-e922721bab1a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.321099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.321798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.322083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.322364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.335776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.337605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.354319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:01.355359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 450/899] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:01.361608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.370596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4f249-48df-45b8-8302-35a8adede99e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.375918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.376512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.376800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.377080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.377791 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:01.378087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.379638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.391976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 450/900] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:01.397247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.406349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37609207-a243-4a8d-990a-04de81ecfc59 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.410467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.411153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.411440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.411722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.419909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.422433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.435788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:01.437536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 451/901] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:01.443003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.452254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34447e40-1d47-4127-8c07-6351d1fec3fd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.456504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdccfa7-9e7b-480e-a646-3063824dae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.457091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdccfa7-9e7b-480e-a646-3063824dae04 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.457364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdccfa7-9e7b-480e-a646-3063824dae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.457649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdccfa7-9e7b-480e-a646-3063824dae04 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.458384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdccfa7-9e7b-480e-a646-3063824dae04 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:01.458688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdccfa7-9e7b-480e-a646-3063824dae04 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.460522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdccfa7-9e7b-480e-a646-3063824dae04 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.478006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 451/902] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:01.479009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:01.488836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d423-5f21-44fe-a57c-be2ccd51587f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:01.492972 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e7ecf-0907-49e3-80e7-3a83fda6a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:01.493764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7ecf-0907-49e3-80e7-3a83fda6a1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:01.494053 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7ecf-0907-49e3-80e7-3a83fda6a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:01.494334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e7ecf-0907-49e3-80e7-3a83fda6a1c0 admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/7dcb623e589c4b17a7a9b3b022c51f96/roles/58f38def815542948bd51acfd4644ea3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:01.513339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7ecf-0907-49e3-80e7-3a83fda6a1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=7dcb623e589c4b17a7a9b3b022c51f96, role_id=58f38def815542948bd51acfd4644ea3)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:01.516056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e7ecf-0907-49e3-80e7-3a83fda6a1c0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:01.528043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 452/903] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:30:01 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/7dcb623e589c4b17a7a9b3b022c51f96/roles/58f38def815542948bd51acfd4644ea3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:30:03.598986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7d59f-6812-4e36-bbd6-20780ec0bfda None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.599559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7d59f-6812-4e36-bbd6-20780ec0bfda None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.599559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7d59f-6812-4e36-bbd6-20780ec0bfda None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.601259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 452/904] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:03.606494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d8a7-62e6-43cb-98f6-5a9ebe14d896 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.606883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d8a7-62e6-43cb-98f6-5a9ebe14d896 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.607064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d8a7-62e6-43cb-98f6-5a9ebe14d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.629785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-aea6d8a7-62e6-43cb-98f6-5a9ebe14d896 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:03.630915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-aea6d8a7-62e6-43cb-98f6-5a9ebe14d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:03.693926 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 453/905] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:03.716876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7d59f-6812-4e36-bbd6-20780ec0bfda None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.729132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7d59f-6812-4e36-bbd6-20780ec0bfda None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.734010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.734644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.734936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.735224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.746075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:03.752816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:30:03.753888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 453/906] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:03.759647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6d8a7-62e6-43cb-98f6-5a9ebe14d896 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.768269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6d8a7-62e6-43cb-98f6-5a9ebe14d896 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.772411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.772994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.773283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.773568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.774278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:03.774580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.776188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:03.785107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 454/907] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:03.790586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.800435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d2d25-b29d-49d5-84f5-4ae9b54b6d0c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.805037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.805732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.806023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.806308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.818125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.819943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:03.837409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:03.838448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 454/908] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:03.844483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.853532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f368-d999-427a-ba9c-e9e92ed6fb27 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.857678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.858249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.858599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.858889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.859570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:03.859870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.861566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:03.873486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 455/909] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:03.880179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.889237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1e198-6cd5-47b2-8faf-9a260f047c41 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.894172 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.894869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.895158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.895441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.907855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.909860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:03.927337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:30:03.928407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 455/910] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:03.933769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.943446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed87896-cb07-4822-9203-ad6fa827d2cd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:03.947568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:03.948172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:03.948462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:03.948744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:03.949523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:03.949822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:03.951617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:03.980825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 456/911] 10.222.0.23 () {56 vars in 1156 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:03.986371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:03.995518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69e674-5918-45be-b1e6-b9a42336a3a4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:04.000404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:04.000968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:04.001263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:04.001553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:04.009096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:04.010857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:04.020529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 456/912] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:30:04.025927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:04.034873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c15f2-3402-450c-a1ba-5d888064e369 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:04.039000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:04.039690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:04.040000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:04.040278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:04.051613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:04.053431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:04.070092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:04.071117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 457/913] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:04.076518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:04.085720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f65ec-6b31-4fe9-86c1-f461b029a150 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:04.090655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:04.091230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:04.091526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:04.091817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:04.092536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:04.092943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:04.094502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:04.106537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 457/914] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:04.112334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:04.121338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95157c6-b174-499b-b691-8f61c9f4a1f9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:04.126252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:04.126943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:04.127228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:04.127504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:04.135636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:04.137573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:04.151048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:04.152102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 458/915] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:04.157620 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:04.166766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a11a8-fbc6-441e-a0ae-5902cbf07246 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:04.171538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6722-a57a-4a0c-9c5f-d22bfa736789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:04.172151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6722-a57a-4a0c-9c5f-d22bfa736789 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:04.172446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6722-a57a-4a0c-9c5f-d22bfa736789 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:04.172730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6722-a57a-4a0c-9c5f-d22bfa736789 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:04.173469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6722-a57a-4a0c-9c5f-d22bfa736789 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:04.173774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6722-a57a-4a0c-9c5f-d22bfa736789 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:04.175570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6722-a57a-4a0c-9c5f-d22bfa736789 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:04.188707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 458/916] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:04.194186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:04.203449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b1b46-45af-4bbd-8918-708bbca2cefc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:04.207560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020def1-0da4-45a6-b4d1-fab15d70965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:04.208150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020def1-0da4-45a6-b4d1-fab15d70965c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:04.208443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020def1-0da4-45a6-b4d1-fab15d70965c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:04.208727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020def1-0da4-45a6-b4d1-fab15d70965c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:04.209501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020def1-0da4-45a6-b4d1-fab15d70965c admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=7dcb623e589c4b17a7a9b3b022c51f96) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:04.209808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020def1-0da4-45a6-b4d1-fab15d70965c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:04.211608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020def1-0da4-45a6-b4d1-fab15d70965c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:04.217131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 459/917] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:04 2022] GET /identity/v3/role_assignments?user.id=7dcb623e589c4b17a7a9b3b022c51f96&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:06.348820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b42a1f-344a-47df-b5f9-d6efcd7e470f None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.349344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b42a1f-344a-47df-b5f9-d6efcd7e470f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.349429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b42a1f-344a-47df-b5f9-d6efcd7e470f None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.351060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 459/918] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:06.356340 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff109b9-0e6e-4909-b6f9-c29a67e2bd13 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.356742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff109b9-0e6e-4909-b6f9-c29a67e2bd13 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.356924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff109b9-0e6e-4909-b6f9-c29a67e2bd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.379910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1ff109b9-0e6e-4909-b6f9-c29a67e2bd13 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:06.381099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1ff109b9-0e6e-4909-b6f9-c29a67e2bd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:06.388082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 460/919] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:06.411070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b42a1f-344a-47df-b5f9-d6efcd7e470f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.423341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b42a1f-344a-47df-b5f9-d6efcd7e470f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.427712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.428445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.428738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.429025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.440132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:06.446439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:06.447523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 460/920] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:06.454283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff109b9-0e6e-4909-b6f9-c29a67e2bd13 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.462816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff109b9-0e6e-4909-b6f9-c29a67e2bd13 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.467043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.468248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.468548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.468837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.469559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:06.469866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.471457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.479899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 461/921] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:06.485433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.495061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3baffa7-2845-436a-ab4e-2aa5d2c54dc2 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.499239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.500046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.500338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.500624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.511439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.513271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.530922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:06.531984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 461/922] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:06.537416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.546904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae54c9a-5ce6-4773-b7e8-166463876808 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.551435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.552272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.552805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.553337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.554103 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:06.554415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.556032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.569822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 462/923] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:06.575401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.585310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2803-e8a3-4009-91dd-b50448379a48 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.589542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.590250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.590541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.590827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.605020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.606955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.624048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:30:06.625090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 462/924] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:06.630751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.640592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b0634-ba67-4a0a-8845-6602dcb254d0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.644825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.645411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.645705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.645991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.646786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:06.647091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.648948 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.677468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 463/925] 10.222.0.23 () {56 vars in 1156 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:06.682911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.692152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8bdee-d990-40a3-9332-54da4726b831 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.696305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.696865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.697158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.697443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.705649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.707376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.716309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 463/926] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:06.722593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.731780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef163ed-d310-4a70-87ef-08e9dbf24235 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.736158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.736872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.737166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.737457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.749225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.751108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.768187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:06.769233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 464/927] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:06.774552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.783123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5618c7-565f-4a23-8a2a-01089c4744ce admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.787352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.787952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.788241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.788526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.789206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:06.789508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.791052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.803313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 464/928] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:06.808643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.818214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e7e6-4350-4e9e-8e02-d267741688a6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.822432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.823126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.823419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.823708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.832827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.835592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.850967 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:06.852883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 465/929] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:06.858908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.868404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb4759-c02f-403a-aba9-852cda4e554e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.872696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c85c0-ed59-4ff7-8b96-c8cb16213aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.873281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c85c0-ed59-4ff7-8b96-c8cb16213aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.873577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c85c0-ed59-4ff7-8b96-c8cb16213aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.874398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c85c0-ed59-4ff7-8b96-c8cb16213aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.875145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c85c0-ed59-4ff7-8b96-c8cb16213aa2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:06.875453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c85c0-ed59-4ff7-8b96-c8cb16213aa2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.877315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c85c0-ed59-4ff7-8b96-c8cb16213aa2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.890372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 465/930] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:06.896235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:06.905573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1e968-71e3-4b4a-981a-8a916f3db469 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:06.909801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a950d9c-41b9-4ee3-8b9d-541d607da43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:06.910373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950d9c-41b9-4ee3-8b9d-541d607da43d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:06.910666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950d9c-41b9-4ee3-8b9d-541d607da43d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:06.910951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a950d9c-41b9-4ee3-8b9d-541d607da43d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:06.911733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a950d9c-41b9-4ee3-8b9d-541d607da43d admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=7dcb623e589c4b17a7a9b3b022c51f96) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:06.912077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a950d9c-41b9-4ee3-8b9d-541d607da43d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:06.913898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a950d9c-41b9-4ee3-8b9d-541d607da43d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:06.919086 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 466/931] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:06 2022] GET /identity/v3/role_assignments?user.id=7dcb623e589c4b17a7a9b3b022c51f96&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:08.991517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439c91-18b2-4f82-adf6-1883c26d9042 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:08.992073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439c91-18b2-4f82-adf6-1883c26d9042 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:08.992186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5439c91-18b2-4f82-adf6-1883c26d9042 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:08.993779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 466/932] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:08.999707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b66ed-6eaa-4d85-b9a8-64df0da3e097 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.000129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b66ed-6eaa-4d85-b9a8-64df0da3e097 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.000368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b66ed-6eaa-4d85-b9a8-64df0da3e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.022889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e83b66ed-6eaa-4d85-b9a8-64df0da3e097 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:09.024071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e83b66ed-6eaa-4d85-b9a8-64df0da3e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:09.031251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 467/933] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:09.054440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5439c91-18b2-4f82-adf6-1883c26d9042 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.067005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5439c91-18b2-4f82-adf6-1883c26d9042 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.071078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.071788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.072201 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.072488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.084007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:09.090278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:09.091348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 467/934] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:09.097186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b66ed-6eaa-4d85-b9a8-64df0da3e097 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.105792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b66ed-6eaa-4d85-b9a8-64df0da3e097 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.110205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.110787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.111079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.111365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.112119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:09.112426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.114011 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.122327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 468/935] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:09.128298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.137735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97530e7c-76d1-4181-a93d-216a87357179 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.142142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.142834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.143123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.143415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.154360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.156729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.173426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:09.174467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 468/936] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:09.180369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.190177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290b5ae-cc83-41de-92bc-6b4a11c12ec4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.194461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.195039 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.195333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.195624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.196343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:09.196652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.198217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.210989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 469/937] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:09.216236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.227345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6620afc-1e6b-43b3-b904-ee3ebb1ad888 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.231657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.232401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.232695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.232983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.245531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.247480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.265866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:30:09.266932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 469/938] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:09.272709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.282419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc838db-e942-4ff0-a291-14e6f95021e1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.286636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.287228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.287522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.287809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.288630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:09.288936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.290757 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.320560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 470/939] 10.222.0.23 () {56 vars in 1156 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:09.325909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.335723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556b48e-17bf-4576-84eb-834a4209c398 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.340001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.340701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.340995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.341285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.352928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.354741 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.371714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:09.372801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 470/940] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:09.379318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.388656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b0b9-cc86-4360-bfde-7189060449dc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.393139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.393720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.394010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.394293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.394979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:09.395282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.396907 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.409274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 471/941] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:09.414665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.424783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef401235-80ad-456b-aed5-91ea5e3f37f6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.429322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.430020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.430314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.430602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.439904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.441868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.455483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:09.456569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 471/942] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:09.462117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.471685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fe433-8dc4-4aa0-ac36-3d09243bdcbb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.475840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1787-4e21-4470-b1f5-1e5d4d11d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.476451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1787-4e21-4470-b1f5-1e5d4d11d70c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.476739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1787-4e21-4470-b1f5-1e5d4d11d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.477020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1787-4e21-4470-b1f5-1e5d4d11d70c admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.477756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1787-4e21-4470-b1f5-1e5d4d11d70c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:09.478055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1787-4e21-4470-b1f5-1e5d4d11d70c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.479858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1787-4e21-4470-b1f5-1e5d4d11d70c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.492809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 472/943] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:09.498523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:09.508258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef649e6a-2d11-4978-807d-6a89cb178be6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:09.512418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665a1db-b82d-4f0d-8e9d-c484768a1e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:09.513214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665a1db-b82d-4f0d-8e9d-c484768a1e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:09.513502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665a1db-b82d-4f0d-8e9d-c484768a1e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:09.513785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665a1db-b82d-4f0d-8e9d-c484768a1e6b admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/7dcb623e589c4b17a7a9b3b022c51f96/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:09.515661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665a1db-b82d-4f0d-8e9d-c484768a1e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=7dcb623e589c4b17a7a9b3b022c51f96, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:09.518295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665a1db-b82d-4f0d-8e9d-c484768a1e6b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:09.530822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 472/944] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:30:09 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/7dcb623e589c4b17a7a9b3b022c51f96/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:30:11.597906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cd4-deec-45f9-8e3c-4e8231c8cb9a None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.598419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cd4-deec-45f9-8e3c-4e8231c8cb9a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.598525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80659cd4-deec-45f9-8e3c-4e8231c8cb9a None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.600200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 473/945] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:11.605252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c136a9-45a6-4064-aada-fe7f1975c07d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.605685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c136a9-45a6-4064-aada-fe7f1975c07d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.605829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c136a9-45a6-4064-aada-fe7f1975c07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.627338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c5c136a9-45a6-4064-aada-fe7f1975c07d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:11.628600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c5c136a9-45a6-4064-aada-fe7f1975c07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:11.691421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 473/946] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:11.715222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80659cd4-deec-45f9-8e3c-4e8231c8cb9a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:11.727511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80659cd4-deec-45f9-8e3c-4e8231c8cb9a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:11.731657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:11.732455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.732701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.732989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.743911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:11.750365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:11.751440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 474/947] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:11.757216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c136a9-45a6-4064-aada-fe7f1975c07d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:11.766107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c136a9-45a6-4064-aada-fe7f1975c07d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:11.770261 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:11.770842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.771132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.771417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.772157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:11.772459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:11.774045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:11.784113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 474/948] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:11.789590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:11.799872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349fee4-d46f-4eef-8851-ac1d5915503e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:11.804310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:11.805005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.805294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.805574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.817157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:11.818955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:11.835638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:11.836699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 475/949] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:30:11.842127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:11.851256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635f6cb-c28f-4b35-a506-180f3c64d831 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:11.855408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:11.856143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.856437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.856723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.857405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:11.857705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:11.860022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:11.874886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 475/950] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:11.880818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:11.892589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84026e79-afc9-4482-b6e9-0017dbd203d1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:11.896942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:11.897664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.897959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.898249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.910834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:11.912862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:11.930781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 08 02:30:11.931843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 476/951] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:11.938236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:11.947389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5af549-f80e-43d1-a712-7f77245bee2b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:11.951506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:11.952603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:11.952897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:11.953183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:11.953966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:11.954269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:11.956109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:11.985415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 476/952] 10.222.0.23 () {56 vars in 1156 bytes} [Fri Apr 8 02:30:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:11.990834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.000215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c5c2b-5f61-4fbd-802a-183afd1d4166 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.004398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.004967 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.005265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.005554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.013114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.014864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:12.023734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 477/953] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:12.029051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.039116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344cfa-a289-4395-86d7-2b04b96c45fb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.043227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.043919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.044235 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.044519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.056910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.058693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:12.075285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:30:12.076356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 477/954] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:12.081802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.090170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeff4eb-a681-4d4a-9ded-c85370abf5d6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.094997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.095569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.095863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.096185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.096867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:12.097171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.098717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:12.111018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 478/955] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:12.116181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.125449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ca71-7bf8-41a1-af96-6c4f1b499a24 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.130031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.130816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.131187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.131562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.140560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.142464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:12.156153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:30:12.157190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 478/956] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:12.163336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.174259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041a7ca-2581-44fa-b391-0a70661b1641 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.179829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5db1a-2187-4f7a-9337-6e10eca1a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.180685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5db1a-2187-4f7a-9337-6e10eca1a443 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.180984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5db1a-2187-4f7a-9337-6e10eca1a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.181275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5db1a-2187-4f7a-9337-6e10eca1a443 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.182030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5db1a-2187-4f7a-9337-6e10eca1a443 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:12.182336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5db1a-2187-4f7a-9337-6e10eca1a443 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.184205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5db1a-2187-4f7a-9337-6e10eca1a443 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:12.196803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 479/957] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:12.202942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:12.212177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41b3ef-2478-426b-b4d5-b39389834a0c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:12.216322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544a886-9462-407e-80c9-0ae73fd2d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:12.216891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544a886-9462-407e-80c9-0ae73fd2d799 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:12.217185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544a886-9462-407e-80c9-0ae73fd2d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:12.217996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544a886-9462-407e-80c9-0ae73fd2d799 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:12.218743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544a886-9462-407e-80c9-0ae73fd2d799 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=7dcb623e589c4b17a7a9b3b022c51f96) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:12.219052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544a886-9462-407e-80c9-0ae73fd2d799 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:12.220907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544a886-9462-407e-80c9-0ae73fd2d799 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:12.226433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 479/958] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:12 2022] GET /identity/v3/role_assignments?user.id=7dcb623e589c4b17a7a9b3b022c51f96&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:14.332959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bec1cc-60f5-4808-9512-c671756b4a8c None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.333499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bec1cc-60f5-4808-9512-c671756b4a8c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.333592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bec1cc-60f5-4808-9512-c671756b4a8c None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.335188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 480/959] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:14.340426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823526-91b3-4ff9-973d-9534be4f2c01 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.340839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823526-91b3-4ff9-973d-9534be4f2c01 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.340996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823526-91b3-4ff9-973d-9534be4f2c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.363779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-9f823526-91b3-4ff9-973d-9534be4f2c01 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:14.364955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9f823526-91b3-4ff9-973d-9534be4f2c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:14.371772 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 480/960] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:14.394217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bec1cc-60f5-4808-9512-c671756b4a8c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:14.406802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bec1cc-60f5-4808-9512-c671756b4a8c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:14.410855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:14.411568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.411856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.412175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.412796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:14.414421 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:14.425825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:30:14.427114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 481/961] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:30:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:14.432721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823526-91b3-4ff9-973d-9534be4f2c01 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:14.441210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823526-91b3-4ff9-973d-9534be4f2c01 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:14.445402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c8d48-159c-4ac2-9125-f4c9a18b9f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:14.445985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8d48-159c-4ac2-9125-f4c9a18b9f5b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.446278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8d48-159c-4ac2-9125-f4c9a18b9f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.446565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8d48-159c-4ac2-9125-f4c9a18b9f5b admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.447239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8d48-159c-4ac2-9125-f4c9a18b9f5b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:14.447542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8d48-159c-4ac2-9125-f4c9a18b9f5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:14.449343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8d48-159c-4ac2-9125-f4c9a18b9f5b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:14.454076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 481/962] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:14.459640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:14.471471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc5bcb-cd03-4752-b1e8-9e1e40d8a078 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:14.475779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9b706-cbc2-4f8c-871d-ea0f813bee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:14.476387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9b706-cbc2-4f8c-871d-ea0f813bee44 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:14.476676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9b706-cbc2-4f8c-871d-ea0f813bee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:14.476957 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9b706-cbc2-4f8c-871d-ea0f813bee44 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:14.477622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9b706-cbc2-4f8c-871d-ea0f813bee44 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:14.477919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9b706-cbc2-4f8c-871d-ea0f813bee44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:14.479477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9b706-cbc2-4f8c-871d-ea0f813bee44 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:14.485049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 482/963] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:16.553996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c6963-8992-48a7-8e57-b33bac76c4f7 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.554512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c6963-8992-48a7-8e57-b33bac76c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.554599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c6963-8992-48a7-8e57-b33bac76c4f7 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.556275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 482/964] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:30:16.561938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41bb2b-dfd5-4491-b3ca-d34c924ceb0f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.562355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41bb2b-dfd5-4491-b3ca-d34c924ceb0f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.562502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41bb2b-dfd5-4491-b3ca-d34c924ceb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.585433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-de41bb2b-dfd5-4491-b3ca-d34c924ceb0f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:16.586578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-de41bb2b-dfd5-4491-b3ca-d34c924ceb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:16.593910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 483/965] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:16.615887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c6963-8992-48a7-8e57-b33bac76c4f7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:16.628436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c6963-8992-48a7-8e57-b33bac76c4f7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:16.632460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a653df-8b76-4005-b974-482c7ba29778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:16.633039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a653df-8b76-4005-b974-482c7ba29778 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:16.633332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a653df-8b76-4005-b974-482c7ba29778 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:16.633618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a653df-8b76-4005-b974-482c7ba29778 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:16.634296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a653df-8b76-4005-b974-482c7ba29778 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:16.635863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a653df-8b76-4005-b974-482c7ba29778 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:16.649481 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 483/966] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:30:16 2022] POST /identity/v3/services => generated 241 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:30:18.743250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db58cb-43af-41de-b1ba-9329ac27b983 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:18.743749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db58cb-43af-41de-b1ba-9329ac27b983 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:18.743749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db58cb-43af-41de-b1ba-9329ac27b983 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:18.745444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 484/967] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:18.751219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ea70-bd23-48c5-b912-1b702270ab46 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:18.751615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ea70-bd23-48c5-b912-1b702270ab46 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:18.751792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69ea70-bd23-48c5-b912-1b702270ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:18.774412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5a69ea70-bd23-48c5-b912-1b702270ab46 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:18.775560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5a69ea70-bd23-48c5-b912-1b702270ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:18.792681 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 484/968] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:18.816573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db58cb-43af-41de-b1ba-9329ac27b983 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:18.836146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db58cb-43af-41de-b1ba-9329ac27b983 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:18.846530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:18.847246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:18.847529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:18.847805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:18.848466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:18.850051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:18.860765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:30:18.861815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 485/969] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:30:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:18.867879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ea70-bd23-48c5-b912-1b702270ab46 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:18.877136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69ea70-bd23-48c5-b912-1b702270ab46 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:18.881294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:18.881872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:18.882162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:18.882464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:18.883134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:18.883438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:18.885033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:18.890929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 485/970] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:18.896534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:18.905996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7526ca-350c-4f5f-aef1-ea68c93909ce admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:18.910267 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:18.910842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:18.911135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:18.911421 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:18.912122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:18.912428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:18.913975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:18.918537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 486/971] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:18.924190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:18.933605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2716ee5-63aa-4111-af7b-add02271cad9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:18.938445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c0b56-e417-4b3d-9b7d-f5d5b9b59769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:18.939017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c0b56-e417-4b3d-9b7d-f5d5b9b59769 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:18.939311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c0b56-e417-4b3d-9b7d-f5d5b9b59769 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:18.939599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c0b56-e417-4b3d-9b7d-f5d5b9b59769 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:18.940387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c0b56-e417-4b3d-9b7d-f5d5b9b59769 admin admin] RBAC: Adding query filter params (interface=public, service_id=bff07564e6504590a5893385e6bdb75e, region_id=RegionOne) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:18.940698 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c0b56-e417-4b3d-9b7d-f5d5b9b59769 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:18.942294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c0b56-e417-4b3d-9b7d-f5d5b9b59769 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:18.947306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 486/972] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:30:18 2022] GET /identity/v3/endpoints?service_id=bff07564e6504590a5893385e6bdb75e&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:18.952953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:18.961794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aaa4d-036c-47f6-a7a8-98c1af273709 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:18.965908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa8b74-165f-461b-9ab8-2222485da43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:18.966465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8b74-165f-461b-9ab8-2222485da43d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:18.966755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8b74-165f-461b-9ab8-2222485da43d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:18.967036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8b74-165f-461b-9ab8-2222485da43d admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:18.967671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa8b74-165f-461b-9ab8-2222485da43d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:18.969226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa8b74-165f-461b-9ab8-2222485da43d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:18.975662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 487/973] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:30:18 2022] GET /identity/v3/services => generated 2196 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:30:21.063619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ecf0e-e490-430c-b342-726fbc2163f9 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:21.064170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ecf0e-e490-430c-b342-726fbc2163f9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:21.064283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ecf0e-e490-430c-b342-726fbc2163f9 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:21.065887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 487/974] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:21.071069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ac5f-2374-47ed-aa3e-e420a1bc0cd7 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:21.071476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ac5f-2374-47ed-aa3e-e420a1bc0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:21.071642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ac5f-2374-47ed-aa3e-e420a1bc0cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:21.093796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b7c3ac5f-2374-47ed-aa3e-e420a1bc0cd7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:21.094921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b7c3ac5f-2374-47ed-aa3e-e420a1bc0cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:21.101822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 488/975] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:21.124700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ecf0e-e490-430c-b342-726fbc2163f9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:21.136237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ecf0e-e490-430c-b342-726fbc2163f9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:21.140353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:21.141061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:21.141351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:21.141633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:21.142248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:21.143814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:21.154232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:30:21.155788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 488/976] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:30:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:21.161565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3ac5f-2374-47ed-aa3e-e420a1bc0cd7 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:21.169950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3ac5f-2374-47ed-aa3e-e420a1bc0cd7 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:21.174764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:21.175341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:21.175629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:21.175909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:21.176871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:21.177171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:21.178727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:21.183418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 489/977] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:21.188721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:21.197773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5a00-1022-497d-87d2-355cdd91b5d7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:21.202164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93666c-059d-4965-adb5-545074530582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:21.202732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93666c-059d-4965-adb5-545074530582 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:21.203028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93666c-059d-4965-adb5-545074530582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:21.203314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93666c-059d-4965-adb5-545074530582 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:21.204014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93666c-059d-4965-adb5-545074530582 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:21.204326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93666c-059d-4965-adb5-545074530582 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:21.205862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93666c-059d-4965-adb5-545074530582 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:21.210486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 489/978] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:21.215453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:21.224981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d0ef8-779f-4eaa-b907-b1858dbbc529 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:21.229170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec818f-bb84-43cd-b5b2-cb07927bd94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:21.229726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec818f-bb84-43cd-b5b2-cb07927bd94d admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:21.230016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec818f-bb84-43cd-b5b2-cb07927bd94d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:21.230323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec818f-bb84-43cd-b5b2-cb07927bd94d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:21.231023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec818f-bb84-43cd-b5b2-cb07927bd94d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:21.233153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec818f-bb84-43cd-b5b2-cb07927bd94d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:21.251720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 490/979] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:30:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:30:23.349729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62877b7e-009e-4021-b684-1a2bbcb01aac None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:23.350295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62877b7e-009e-4021-b684-1a2bbcb01aac None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:23.350295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62877b7e-009e-4021-b684-1a2bbcb01aac None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:23.351984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 490/980] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:23.357128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368096-2503-4970-96f0-da837e962167 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:23.358073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368096-2503-4970-96f0-da837e962167 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:23.358249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd368096-2503-4970-96f0-da837e962167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:23.379758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-dd368096-2503-4970-96f0-da837e962167 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:23.380941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-dd368096-2503-4970-96f0-da837e962167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:23.397814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 491/981] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:23.420413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62877b7e-009e-4021-b684-1a2bbcb01aac None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:23.432239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62877b7e-009e-4021-b684-1a2bbcb01aac None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:23.436823 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:23.437536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:23.437828 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:23.438113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:23.438736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:23.440350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:23.450709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:30:23.452382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 491/982] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:30:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:23.458268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368096-2503-4970-96f0-da837e962167 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:23.466835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd368096-2503-4970-96f0-da837e962167 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:23.471157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:23.471743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:23.472057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:23.472343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:23.473028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:23.473332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:23.474912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:23.479617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 492/983] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:23.485565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:23.495721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586ab0-6069-4113-bc5a-eafe7514ec44 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:23.502150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:23.502739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:23.503474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:23.503767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:23.504505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:23.504799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:23.507700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:23.515061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 492/984] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:23.521178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:23.531049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46410b-7054-4609-8101-d58b5cb9328e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:23.535273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0f10b-f2fb-4b18-8816-f49c752b93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:23.535854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f10b-f2fb-4b18-8816-f49c752b93b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:23.536243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f10b-f2fb-4b18-8816-f49c752b93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:23.536533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0f10b-f2fb-4b18-8816-f49c752b93b5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:23.537486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f10b-f2fb-4b18-8816-f49c752b93b5 admin admin] RBAC: Adding query filter params (interface=admin, service_id=bff07564e6504590a5893385e6bdb75e, region_id=RegionOne) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:23.537797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f10b-f2fb-4b18-8816-f49c752b93b5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:23.539370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0f10b-f2fb-4b18-8816-f49c752b93b5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:23.544695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 493/985] 10.222.0.23 () {56 vars in 1270 bytes} [Fri Apr 8 02:30:23 2022] GET /identity/v3/endpoints?service_id=bff07564e6504590a5893385e6bdb75e&interface=admin®ion_id=RegionOne => generated 193 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:23.550542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:23.560029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fcff6-8ece-4a74-9bfd-3b8a674578df admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:23.564905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654ff1-3b70-4509-8a9b-9562fdc0c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:23.565483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654ff1-3b70-4509-8a9b-9562fdc0c054 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:23.565773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654ff1-3b70-4509-8a9b-9562fdc0c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:23.566056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654ff1-3b70-4509-8a9b-9562fdc0c054 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:23.566702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2654ff1-3b70-4509-8a9b-9562fdc0c054 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:23.568300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2654ff1-3b70-4509-8a9b-9562fdc0c054 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:23.574785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 493/986] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:30:23 2022] GET /identity/v3/services => generated 2196 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:30:25.648846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee886a9-e579-4e97-9f2c-dfc179c70149 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.649396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee886a9-e579-4e97-9f2c-dfc179c70149 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.649396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee886a9-e579-4e97-9f2c-dfc179c70149 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.651163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 494/987] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:25.656882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e16b0a-4ee9-42f5-8f75-87bb36e2afb4 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.657298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e16b0a-4ee9-42f5-8f75-87bb36e2afb4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.657446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e16b0a-4ee9-42f5-8f75-87bb36e2afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.679945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d7e16b0a-4ee9-42f5-8f75-87bb36e2afb4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:25.681097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d7e16b0a-4ee9-42f5-8f75-87bb36e2afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:25.688474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 494/988] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:25.710868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee886a9-e579-4e97-9f2c-dfc179c70149 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:25.723466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee886a9-e579-4e97-9f2c-dfc179c70149 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:25.727470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:25.728215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.728503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.728782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.729397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:25.730968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:25.742491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 08 02:30:25.743508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 495/989] 10.222.0.23 () {56 vars in 1147 bytes} [Fri Apr 8 02:30:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:25.749228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e16b0a-4ee9-42f5-8f75-87bb36e2afb4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:25.757727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e16b0a-4ee9-42f5-8f75-87bb36e2afb4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:25.761929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:25.762512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.762805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.763090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.763766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:25.764190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:25.765768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:25.770468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 495/990] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:25.775825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:25.785519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf79a-210a-4684-9007-167fa479b2d8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:25.789746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d29379-553b-45a9-ade1-fcd7674743f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:25.790315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d29379-553b-45a9-ade1-fcd7674743f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.790607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d29379-553b-45a9-ade1-fcd7674743f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.790891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d29379-553b-45a9-ade1-fcd7674743f3 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.791556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d29379-553b-45a9-ade1-fcd7674743f3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:25.791858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d29379-553b-45a9-ade1-fcd7674743f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:25.793413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d29379-553b-45a9-ade1-fcd7674743f3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:25.798663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 496/991] 10.222.0.23 () {56 vars in 1143 bytes} [Fri Apr 8 02:30:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:25.804093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:25.812990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111e3f-dfd1-4b3e-bb6e-daff044b5cd0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:25.817173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba606a79-9e0a-4f57-9a7f-17a72fe0a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:25.817728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba606a79-9e0a-4f57-9a7f-17a72fe0a2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:25.818021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba606a79-9e0a-4f57-9a7f-17a72fe0a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:25.818312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba606a79-9e0a-4f57-9a7f-17a72fe0a2b3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:25.819001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba606a79-9e0a-4f57-9a7f-17a72fe0a2b3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:25.820560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba606a79-9e0a-4f57-9a7f-17a72fe0a2b3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:25.835361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 496/992] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:30:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:30:27.932022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69583073-837b-487a-9b61-8c159908946b None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:27.932552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69583073-837b-487a-9b61-8c159908946b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:27.932755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69583073-837b-487a-9b61-8c159908946b None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:27.934288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 497/993] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:27.940039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82507e-25c2-462f-b0df-a492b00faf8d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:27.940433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82507e-25c2-462f-b0df-a492b00faf8d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:27.940619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82507e-25c2-462f-b0df-a492b00faf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:27.962848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3f82507e-25c2-462f-b0df-a492b00faf8d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:27.964024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3f82507e-25c2-462f-b0df-a492b00faf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:27.981207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 497/994] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:27 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:28.005083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69583073-837b-487a-9b61-8c159908946b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:28.017514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69583073-837b-487a-9b61-8c159908946b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:28.021551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e5bf7-d23b-41fc-a69c-31c4e3d8347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:28.022257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5bf7-d23b-41fc-a69c-31c4e3d8347f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:28.022545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5bf7-d23b-41fc-a69c-31c4e3d8347f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:28.022823 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e5bf7-d23b-41fc-a69c-31c4e3d8347f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:28.023875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e5bf7-d23b-41fc-a69c-31c4e3d8347f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:28.025555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e5bf7-d23b-41fc-a69c-31c4e3d8347f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:28.026981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 498/995] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:28.033124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82507e-25c2-462f-b0df-a492b00faf8d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:28.041685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82507e-25c2-462f-b0df-a492b00faf8d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:28.046352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e6190-213f-4eba-bde7-0b5d6ad5f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:28.046930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6190-213f-4eba-bde7-0b5d6ad5f2dd admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:28.047221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6190-213f-4eba-bde7-0b5d6ad5f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:28.047505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6190-213f-4eba-bde7-0b5d6ad5f2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:28.048204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6190-213f-4eba-bde7-0b5d6ad5f2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:28.050094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6190-213f-4eba-bde7-0b5d6ad5f2dd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:28.078453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 498/996] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:30:28 2022] POST /identity/v3/projects => generated 311 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:30:30.219636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91527b-5f82-4360-96ac-5809dd948435 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:30.220217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91527b-5f82-4360-96ac-5809dd948435 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:30.220217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91527b-5f82-4360-96ac-5809dd948435 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:30.221882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 499/997] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:30.227192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aa780-eb36-45a4-a5af-ed2235c3aeba None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:30.227619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aa780-eb36-45a4-a5af-ed2235c3aeba None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:30.227771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6aa780-eb36-45a4-a5af-ed2235c3aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:30.250683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-dc6aa780-eb36-45a4-a5af-ed2235c3aeba None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:30.251822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-dc6aa780-eb36-45a4-a5af-ed2235c3aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:30.315013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 499/998] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:30 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:30.339497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91527b-5f82-4360-96ac-5809dd948435 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:30.351168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91527b-5f82-4360-96ac-5809dd948435 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:30.355206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c6867-6404-4a5b-9f3f-5b569cec167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:30.355912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c6867-6404-4a5b-9f3f-5b569cec167d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:30.356226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c6867-6404-4a5b-9f3f-5b569cec167d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:30.356511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c6867-6404-4a5b-9f3f-5b569cec167d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:30.358189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c6867-6404-4a5b-9f3f-5b569cec167d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:30.359860 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c6867-6404-4a5b-9f3f-5b569cec167d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:30.361313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 500/999] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:30.366592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6aa780-eb36-45a4-a5af-ed2235c3aeba None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:30.375719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6aa780-eb36-45a4-a5af-ed2235c3aeba None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:30.379984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7111a3-d009-4bbd-8c17-a7de60c7b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:30.380578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7111a3-d009-4bbd-8c17-a7de60c7b54d admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:30.380870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7111a3-d009-4bbd-8c17-a7de60c7b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:30.381157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7111a3-d009-4bbd-8c17-a7de60c7b54d admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:30.381853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7111a3-d009-4bbd-8c17-a7de60c7b54d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:30.383761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7111a3-d009-4bbd-8c17-a7de60c7b54d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:30.402573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 500/1000] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:30:30 2022] POST /identity/v3/users => generated 285 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:32.599428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349515f9-3387-4ab5-893b-34d280d941f1 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.600036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349515f9-3387-4ab5-893b-34d280d941f1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.600036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349515f9-3387-4ab5-893b-34d280d941f1 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.601681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 501/1001] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:32.607469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa959-58ef-4de3-916e-d3a8840af0d3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.607970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa959-58ef-4de3-916e-d3a8840af0d3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.608083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa959-58ef-4de3-916e-d3a8840af0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.630070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-140aa959-58ef-4de3-916e-d3a8840af0d3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:32.631245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-140aa959-58ef-4de3-916e-d3a8840af0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:32.638841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 501/1002] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:32 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:32.662871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349515f9-3387-4ab5-893b-34d280d941f1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:32.674554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349515f9-3387-4ab5-893b-34d280d941f1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:32.678827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:32.679529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.679816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.680133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.691667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:32.697929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:32.699002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 502/1003] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:32.705952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa959-58ef-4de3-916e-d3a8840af0d3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:32.714615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa959-58ef-4de3-916e-d3a8840af0d3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:32.719678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:32.720298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.720593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.720882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.721606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:32.721913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:32.723500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:32.732113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 502/1004] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:32.737542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:32.746495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b7b11-4a17-417c-8343-066ff24ff77d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:32.751022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:32.751796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.752117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.752404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] PATH_INFO: `/v3/users/a60b610b1d3a4fd2afa50109e84a7cde` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.771693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] RBAC: Authorizing `identity:get_user(user_id=a60b610b1d3a4fd2afa50109e84a7cde)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:32.773839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:32.775295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 503/1005] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:32 2022] GET /identity/v3/users/a60b610b1d3a4fd2afa50109e84a7cde => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:32.781882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:32.791035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dc736-7c31-414c-96c0-e65269d25005 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:32.795445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:32.796047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.796346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.796636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.804478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:32.806205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:32.814613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 503/1006] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:32 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:30:32.819903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:32.829436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9a39-1154-4a9c-8ab7-680555fe5a92 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:32.833593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cda1b-07a4-450c-827e-7bad5bebad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:32.834360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cda1b-07a4-450c-827e-7bad5bebad5d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.834647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cda1b-07a4-450c-827e-7bad5bebad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.834929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cda1b-07a4-450c-827e-7bad5bebad5d admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.836023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cda1b-07a4-450c-827e-7bad5bebad5d admin admin] RBAC: Authorizing `identity:get_project(project_id=cd9845ead80548eca895b91aae981fe7)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:32.837993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cda1b-07a4-450c-827e-7bad5bebad5d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:32.839452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 504/1007] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:32 2022] GET /identity/v3/projects/cd9845ead80548eca895b91aae981fe7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:32.845781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:32.854024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6338b7f-56c2-48ab-a42e-971569a401ab admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:32.858486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b23e2-3fa8-4454-9c91-2153105469fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:32.859049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b23e2-3fa8-4454-9c91-2153105469fe admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:32.859341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b23e2-3fa8-4454-9c91-2153105469fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:32.859629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b23e2-3fa8-4454-9c91-2153105469fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:32.860470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b23e2-3fa8-4454-9c91-2153105469fe admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=cd9845ead80548eca895b91aae981fe7, user.id=a60b610b1d3a4fd2afa50109e84a7cde) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:32.860779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b23e2-3fa8-4454-9c91-2153105469fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:32.862554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b23e2-3fa8-4454-9c91-2153105469fe admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:32.867877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 504/1008] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:32 2022] GET /identity/v3/role_assignments?user.id=a60b610b1d3a4fd2afa50109e84a7cde&scope.project.id=cd9845ead80548eca895b91aae981fe7&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:34.937954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c3cdf-d089-4039-8433-3c5a15d28ed0 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:34.938545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c3cdf-d089-4039-8433-3c5a15d28ed0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:34.938545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c3cdf-d089-4039-8433-3c5a15d28ed0 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:34.940223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 505/1009] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:34.945389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c088d-8177-4967-9cf4-6948a13b3865 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:34.945805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c088d-8177-4967-9cf4-6948a13b3865 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:34.945972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c088d-8177-4967-9cf4-6948a13b3865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:34.968526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-850c088d-8177-4967-9cf4-6948a13b3865 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:34.969659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-850c088d-8177-4967-9cf4-6948a13b3865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:34.976586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 505/1010] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:34.999003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c3cdf-d089-4039-8433-3c5a15d28ed0 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:35.010548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c3cdf-d089-4039-8433-3c5a15d28ed0 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:35.015223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:35.015945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:35.016253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:35.016539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:35.027307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:35.034174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:35.035242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 506/1011] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:35.040806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c088d-8177-4967-9cf4-6948a13b3865 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:35.049352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c088d-8177-4967-9cf4-6948a13b3865 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:35.053836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:35.054416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:35.054709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:35.054997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:35.055709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:35.056045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:35.057612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:35.065891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 506/1012] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:35.071181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:35.081571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfbf99-4b7a-492b-a3a8-0e19343b363b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:35.085720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:35.086477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:35.086769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:35.087049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] PATH_INFO: `/v3/users/a60b610b1d3a4fd2afa50109e84a7cde` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:35.088171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a60b610b1d3a4fd2afa50109e84a7cde)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:35.090232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:35.092723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 507/1013] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:35 2022] GET /identity/v3/users/a60b610b1d3a4fd2afa50109e84a7cde => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:35.097858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:35.107001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73bc79-d28c-4bf2-9c1a-0f17a2f14e07 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:35.111211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105e62b-622b-4320-84f1-3fafd0bd75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:35.112010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105e62b-622b-4320-84f1-3fafd0bd75e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:35.112305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105e62b-622b-4320-84f1-3fafd0bd75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:35.112594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105e62b-622b-4320-84f1-3fafd0bd75e3 admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:35.113668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105e62b-622b-4320-84f1-3fafd0bd75e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd9845ead80548eca895b91aae981fe7)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:35.115680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105e62b-622b-4320-84f1-3fafd0bd75e3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:35.117185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 507/1014] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:35 2022] GET /identity/v3/projects/cd9845ead80548eca895b91aae981fe7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:35.122772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:35.131737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0720b0-bdec-4e81-b8e1-ffa7412ab8d1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:35.136009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834c15-fbe0-4155-8ee6-9bc424641647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:35.136789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834c15-fbe0-4155-8ee6-9bc424641647 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:35.137083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834c15-fbe0-4155-8ee6-9bc424641647 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:35.137373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834c15-fbe0-4155-8ee6-9bc424641647 admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7/users/a60b610b1d3a4fd2afa50109e84a7cde/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:35.139861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834c15-fbe0-4155-8ee6-9bc424641647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9845ead80548eca895b91aae981fe7, user_id=a60b610b1d3a4fd2afa50109e84a7cde, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:35.142461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834c15-fbe0-4155-8ee6-9bc424641647 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:35.156752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 508/1015] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:30:35 2022] PUT /identity/v3/projects/cd9845ead80548eca895b91aae981fe7/users/a60b610b1d3a4fd2afa50109e84a7cde/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:30:37.225283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f2f6-a22a-48ef-b1b3-891577c906a7 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.225819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f2f6-a22a-48ef-b1b3-891577c906a7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.225904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f2f6-a22a-48ef-b1b3-891577c906a7 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.227547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 508/1016] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:37.233280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a3f2-fc41-4f98-b929-741f1d7e7672 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.233701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a3f2-fc41-4f98-b929-741f1d7e7672 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.233853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471a3f2-fc41-4f98-b929-741f1d7e7672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.256360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2471a3f2-fc41-4f98-b929-741f1d7e7672 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:37.257503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2471a3f2-fc41-4f98-b929-741f1d7e7672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:37.324275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 509/1017] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:37 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:37.347522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83f2f6-a22a-48ef-b1b3-891577c906a7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:37.360282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83f2f6-a22a-48ef-b1b3-891577c906a7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:37.364425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:37.365144 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.365441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.365730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.378184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:37.384509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:37.390907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 509/1018] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:37.392252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a3f2-fc41-4f98-b929-741f1d7e7672 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:37.401507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471a3f2-fc41-4f98-b929-741f1d7e7672 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:37.406018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:37.406606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.406895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.407182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.407897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:37.408260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:37.409859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:37.418564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 510/1019] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:37.424901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:37.434383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60df62-6cc6-4040-abb3-075c48c97bd6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:37.439336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:37.440159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.440451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.440738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] PATH_INFO: `/v3/users/a60b610b1d3a4fd2afa50109e84a7cde` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.441849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] RBAC: Authorizing `identity:get_user(user_id=a60b610b1d3a4fd2afa50109e84a7cde)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:37.443973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:37.445408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 510/1020] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:37 2022] GET /identity/v3/users/a60b610b1d3a4fd2afa50109e84a7cde => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:37.450906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:37.460135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684df6-ff3c-4fa1-91ec-6f66b0851734 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:37.464350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:37.464916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.465208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.465494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.473679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:37.475449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:37.484572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 511/1021] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:37 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:30:37.490207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:37.499580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0ef6d-fe6a-42c1-a499-390029196944 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:37.503779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf4b3-1d84-4c0f-afc1-aee90d1ec406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:37.504593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf4b3-1d84-4c0f-afc1-aee90d1ec406 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.504889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf4b3-1d84-4c0f-afc1-aee90d1ec406 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.505178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf4b3-1d84-4c0f-afc1-aee90d1ec406 admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.506255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf4b3-1d84-4c0f-afc1-aee90d1ec406 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd9845ead80548eca895b91aae981fe7)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:37.508310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf4b3-1d84-4c0f-afc1-aee90d1ec406 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:37.509802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 511/1022] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:37 2022] GET /identity/v3/projects/cd9845ead80548eca895b91aae981fe7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:37.515365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:37.523597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9e7e5-6a35-445b-b641-fd827596dcfe admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:37.527792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698467bf-3609-44da-b3c0-f675c61d60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:37.528381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698467bf-3609-44da-b3c0-f675c61d60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:37.529173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698467bf-3609-44da-b3c0-f675c61d60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:37.529451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698467bf-3609-44da-b3c0-f675c61d60a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:37.530219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698467bf-3609-44da-b3c0-f675c61d60a9 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=cd9845ead80548eca895b91aae981fe7, user.id=a60b610b1d3a4fd2afa50109e84a7cde) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:37.530521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698467bf-3609-44da-b3c0-f675c61d60a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:37.532347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698467bf-3609-44da-b3c0-f675c61d60a9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:37.537784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 512/1023] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:37 2022] GET /identity/v3/role_assignments?user.id=a60b610b1d3a4fd2afa50109e84a7cde&scope.project.id=cd9845ead80548eca895b91aae981fe7&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:39.701225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0992d9-5219-499c-872a-cc64349430af None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:39.701768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0992d9-5219-499c-872a-cc64349430af None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:39.701768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0992d9-5219-499c-872a-cc64349430af None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:39.704024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 512/1024] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:39.709139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018d6f-7995-4023-975e-30ca2e19adc8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:39.709578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018d6f-7995-4023-975e-30ca2e19adc8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:39.709715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4018d6f-7995-4023-975e-30ca2e19adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:39.732187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f4018d6f-7995-4023-975e-30ca2e19adc8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:39.733268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f4018d6f-7995-4023-975e-30ca2e19adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:39.740268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 513/1025] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:39 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:39.765558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0992d9-5219-499c-872a-cc64349430af None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:39.777321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0992d9-5219-499c-872a-cc64349430af None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:39.781560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842af14-be36-4311-a24c-3d6e54ac8c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:39.782267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842af14-be36-4311-a24c-3d6e54ac8c17 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:39.782562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842af14-be36-4311-a24c-3d6e54ac8c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:39.782850 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842af14-be36-4311-a24c-3d6e54ac8c17 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:39.783949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842af14-be36-4311-a24c-3d6e54ac8c17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:39.785638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842af14-be36-4311-a24c-3d6e54ac8c17 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:39.787075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 513/1026] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:39.792570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4018d6f-7995-4023-975e-30ca2e19adc8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:39.801473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4018d6f-7995-4023-975e-30ca2e19adc8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:39.805632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bed830-301d-4e75-9226-27e71b204ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:39.806217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bed830-301d-4e75-9226-27e71b204ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:39.806510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bed830-301d-4e75-9226-27e71b204ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:39.806796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bed830-301d-4e75-9226-27e71b204ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:39.807446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bed830-301d-4e75-9226-27e71b204ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:39.809358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bed830-301d-4e75-9226-27e71b204ca4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:39.829683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 514/1027] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:30:39 2022] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:41.960096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236522-6af8-4539-8612-e741d360987b None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:41.960656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236522-6af8-4539-8612-e741d360987b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:41.960656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236522-6af8-4539-8612-e741d360987b None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:41.962326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 514/1028] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:41.968600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1b9f-e022-487f-9f7c-9634b5aadfed None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:41.969018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1b9f-e022-487f-9f7c-9634b5aadfed None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:41.969177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d1b9f-e022-487f-9f7c-9634b5aadfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:41.990837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5e3d1b9f-e022-487f-9f7c-9634b5aadfed None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:41.992016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5e3d1b9f-e022-487f-9f7c-9634b5aadfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:41.999480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 515/1029] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:41 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:42.023136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45236522-6af8-4539-8612-e741d360987b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.034822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45236522-6af8-4539-8612-e741d360987b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.038895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.039661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.039982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.040272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] PATH_INFO: `/v3/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.041611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] RBAC: Authorizing `identity:get_role(role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.042604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:30:42.042604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:30:42.042604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:30:42.043477 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:42.044764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 515/1030] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/roles/5469eafdf12343518fe61660749f0e85 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:42.050233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1b9f-e022-487f-9f7c-9634b5aadfed None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.058887 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d1b9f-e022-487f-9f7c-9634b5aadfed None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.063913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.064733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.065026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.065313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] PATH_INFO: `/v3/users/366894f2ce724c4ca664fce40880f7c8` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.083747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] RBAC: Authorizing `identity:get_user(user_id=366894f2ce724c4ca664fce40880f7c8)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.085891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:42.087353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 516/1031] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/users/366894f2ce724c4ca664fce40880f7c8 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:42.092898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.102014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0250f-3625-4eac-a04b-ed9028223d0f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.106216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.106961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.107233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.107521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.115024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.116777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:42.126353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 516/1032] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:42.131864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.141641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da197f8b-b7af-42ab-97e1-ce4985b21f8b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.145816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54d4a8-088f-44ef-81b5-8eb7435fc297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.146585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d4a8-088f-44ef-81b5-8eb7435fc297 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.146874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d4a8-088f-44ef-81b5-8eb7435fc297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.147159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d4a8-088f-44ef-81b5-8eb7435fc297 admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.148260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54d4a8-088f-44ef-81b5-8eb7435fc297 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd9845ead80548eca895b91aae981fe7)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.150253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54d4a8-088f-44ef-81b5-8eb7435fc297 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:42.151723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 517/1033] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/projects/cd9845ead80548eca895b91aae981fe7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:42.157256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:42.165469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a54d12-7563-467f-a88e-7c9a87cdd9ab admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:42.169832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af20087-1da2-4de7-a360-d7e9698ece13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:42.170383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af20087-1da2-4de7-a360-d7e9698ece13 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:42.170676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af20087-1da2-4de7-a360-d7e9698ece13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:42.170963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af20087-1da2-4de7-a360-d7e9698ece13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:42.171732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af20087-1da2-4de7-a360-d7e9698ece13 admin admin] RBAC: Adding query filter params (role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=cd9845ead80548eca895b91aae981fe7, user.id=366894f2ce724c4ca664fce40880f7c8) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:42.172077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af20087-1da2-4de7-a360-d7e9698ece13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:42.173862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af20087-1da2-4de7-a360-d7e9698ece13 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:42.179209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 517/1034] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:42 2022] GET /identity/v3/role_assignments?user.id=366894f2ce724c4ca664fce40880f7c8&scope.project.id=cd9845ead80548eca895b91aae981fe7&role.id=5469eafdf12343518fe61660749f0e85 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:44.260199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67660a-06a3-4cf0-88b7-1fee7908d640 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.260756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67660a-06a3-4cf0-88b7-1fee7908d640 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.260756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67660a-06a3-4cf0-88b7-1fee7908d640 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.262412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 518/1035] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:44.268230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d1e3-07cf-4b66-9e51-de21c609b3b0 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.268601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d1e3-07cf-4b66-9e51-de21c609b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.268809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d1e3-07cf-4b66-9e51-de21c609b3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.292018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3d84d1e3-07cf-4b66-9e51-de21c609b3b0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:44.293355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3d84d1e3-07cf-4b66-9e51-de21c609b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:44.300708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 518/1036] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:44.323614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67660a-06a3-4cf0-88b7-1fee7908d640 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:44.336279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67660a-06a3-4cf0-88b7-1fee7908d640 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:44.340367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:44.341195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.341489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.341879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] PATH_INFO: `/v3/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.343241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] RBAC: Authorizing `identity:get_role(role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:44.344283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:30:44.344283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:30:44.344283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:30:44.345168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:44.346390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 519/1037] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:44 2022] GET /identity/v3/roles/5469eafdf12343518fe61660749f0e85 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:44.352614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84d1e3-07cf-4b66-9e51-de21c609b3b0 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:44.361212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84d1e3-07cf-4b66-9e51-de21c609b3b0 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:44.365469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:44.366255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.366551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.366842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] PATH_INFO: `/v3/users/366894f2ce724c4ca664fce40880f7c8` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.367992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=366894f2ce724c4ca664fce40880f7c8)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:44.370057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:44.371491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 519/1038] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:44 2022] GET /identity/v3/users/366894f2ce724c4ca664fce40880f7c8 => generated 286 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:44.377926 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:44.387036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae83d-9ccf-4de7-8fea-eaa147f14a32 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:44.392359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318dcf4-518f-4c33-823c-3dc4d5746327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:44.393157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318dcf4-518f-4c33-823c-3dc4d5746327 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.393449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318dcf4-518f-4c33-823c-3dc4d5746327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.393738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318dcf4-518f-4c33-823c-3dc4d5746327 admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.394821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318dcf4-518f-4c33-823c-3dc4d5746327 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd9845ead80548eca895b91aae981fe7)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:44.396874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318dcf4-518f-4c33-823c-3dc4d5746327 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:44.398393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 520/1039] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:44 2022] GET /identity/v3/projects/cd9845ead80548eca895b91aae981fe7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:44.403653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:44.412683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8c4f-dcf7-44fe-aa1f-35641a7e90c8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:44.416858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091684ed-b8b5-4ed1-a859-6b67a55ea27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:44.417640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091684ed-b8b5-4ed1-a859-6b67a55ea27f admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:44.417930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091684ed-b8b5-4ed1-a859-6b67a55ea27f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:44.418217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091684ed-b8b5-4ed1-a859-6b67a55ea27f admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7/users/366894f2ce724c4ca664fce40880f7c8/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:44.420522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091684ed-b8b5-4ed1-a859-6b67a55ea27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9845ead80548eca895b91aae981fe7, user_id=366894f2ce724c4ca664fce40880f7c8, role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:44.423089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091684ed-b8b5-4ed1-a859-6b67a55ea27f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:44.436528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 520/1040] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:30:44 2022] PUT /identity/v3/projects/cd9845ead80548eca895b91aae981fe7/users/366894f2ce724c4ca664fce40880f7c8/roles/5469eafdf12343518fe61660749f0e85 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:30:46.500774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56224-ea41-496b-9f36-f5863eda4d5b None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.501248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56224-ea41-496b-9f36-f5863eda4d5b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.501369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd56224-ea41-496b-9f36-f5863eda4d5b None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.503000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 521/1041] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:46.508076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924edb-a67c-44fa-93fb-b66493a36b38 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.508510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924edb-a67c-44fa-93fb-b66493a36b38 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.508657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d924edb-a67c-44fa-93fb-b66493a36b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.530660 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4d924edb-a67c-44fa-93fb-b66493a36b38 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:46.531793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4d924edb-a67c-44fa-93fb-b66493a36b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:46.594637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 521/1042] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:46 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:46.618393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd56224-ea41-496b-9f36-f5863eda4d5b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:46.630282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd56224-ea41-496b-9f36-f5863eda4d5b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:46.634441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:46.635248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.635540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.635826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] PATH_INFO: `/v3/roles/5469eafdf12343518fe61660749f0e85` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.637223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] RBAC: Authorizing `identity:get_role(role_id=5469eafdf12343518fe61660749f0e85)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:46.639182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:46.640513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 522/1043] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:46 2022] GET /identity/v3/roles/5469eafdf12343518fe61660749f0e85 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:46.646587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d924edb-a67c-44fa-93fb-b66493a36b38 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:46.656329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d924edb-a67c-44fa-93fb-b66493a36b38 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:46.661588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:46.662379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.662672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.662960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] PATH_INFO: `/v3/users/366894f2ce724c4ca664fce40880f7c8` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.664104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] RBAC: Authorizing `identity:get_user(user_id=366894f2ce724c4ca664fce40880f7c8)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:46.666210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:46.667669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 522/1044] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:46 2022] GET /identity/v3/users/366894f2ce724c4ca664fce40880f7c8 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:46.673964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:46.683600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e91eea-4538-4b24-9bbe-85a481f362a1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:46.688277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:46.688842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.689128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.689409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.697241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:46.698950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:46.707775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 523/1045] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:46 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:46.713198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:46.722905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1ce1-8a11-45f4-b2c7-314968208e99 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:46.727094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa709e8-2575-4261-ab05-6a7c0fbdba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:46.727857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa709e8-2575-4261-ab05-6a7c0fbdba64 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.728185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa709e8-2575-4261-ab05-6a7c0fbdba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.728474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa709e8-2575-4261-ab05-6a7c0fbdba64 admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.729548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa709e8-2575-4261-ab05-6a7c0fbdba64 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd9845ead80548eca895b91aae981fe7)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:46.732186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa709e8-2575-4261-ab05-6a7c0fbdba64 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:46.733795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 523/1046] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:46 2022] GET /identity/v3/projects/cd9845ead80548eca895b91aae981fe7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:46.739316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:46.747642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871cb4-2bcf-4d78-aaef-bbcf5d0df82d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:46.751873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07923d7f-3622-48dd-9425-907cf1d78fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:46.752452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923d7f-3622-48dd-9425-907cf1d78fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:46.752741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923d7f-3622-48dd-9425-907cf1d78fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:46.753023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07923d7f-3622-48dd-9425-907cf1d78fe2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:46.753787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923d7f-3622-48dd-9425-907cf1d78fe2 admin admin] RBAC: Adding query filter params (role.id=5469eafdf12343518fe61660749f0e85, scope.project.id=cd9845ead80548eca895b91aae981fe7, user.id=366894f2ce724c4ca664fce40880f7c8) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:46.754088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923d7f-3622-48dd-9425-907cf1d78fe2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:46.755885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07923d7f-3622-48dd-9425-907cf1d78fe2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:46.761377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 524/1047] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:46 2022] GET /identity/v3/role_assignments?user.id=366894f2ce724c4ca664fce40880f7c8&scope.project.id=cd9845ead80548eca895b91aae981fe7&role.id=5469eafdf12343518fe61660749f0e85 => generated 608 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:48.874535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231b6d-4a19-4e85-95d5-53da2a16307d None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:48.875267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231b6d-4a19-4e85-95d5-53da2a16307d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:48.875267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed231b6d-4a19-4e85-95d5-53da2a16307d None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:48.876831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 524/1048] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:48.882284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83c29-2339-490c-b91e-39af7022cc06 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:48.882711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83c29-2339-490c-b91e-39af7022cc06 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:48.882847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b83c29-2339-490c-b91e-39af7022cc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:48.905898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f6b83c29-2339-490c-b91e-39af7022cc06 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:48.907037 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f6b83c29-2339-490c-b91e-39af7022cc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:48.913970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 525/1049] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:30:48.938412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231b6d-4a19-4e85-95d5-53da2a16307d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:48.950692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed231b6d-4a19-4e85-95d5-53da2a16307d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:48.954841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d80f0-2f51-4b9e-9ae4-b731e4359059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:48.955554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d80f0-2f51-4b9e-9ae4-b731e4359059 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:48.955854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d80f0-2f51-4b9e-9ae4-b731e4359059 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:48.956188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d80f0-2f51-4b9e-9ae4-b731e4359059 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:48.957270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d80f0-2f51-4b9e-9ae4-b731e4359059 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:48.958978 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d80f0-2f51-4b9e-9ae4-b731e4359059 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:48.960449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 525/1050] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:48.965783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b83c29-2339-490c-b91e-39af7022cc06 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:48.974182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b83c29-2339-490c-b91e-39af7022cc06 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:48.978410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5889e-0e9c-48c0-b2be-150b1cc1884b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:48.978975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5889e-0e9c-48c0-b2be-150b1cc1884b admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:48.979261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5889e-0e9c-48c0-b2be-150b1cc1884b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:48.979542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5889e-0e9c-48c0-b2be-150b1cc1884b admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:48.980222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5889e-0e9c-48c0-b2be-150b1cc1884b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:48.982223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5889e-0e9c-48c0-b2be-150b1cc1884b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:49.008524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 526/1051] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:30:48 2022] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:30:51.133576 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa557e2-f711-47c1-8d04-f60378f74425 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.134112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa557e2-f711-47c1-8d04-f60378f74425 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.134206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa557e2-f711-47c1-8d04-f60378f74425 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.135816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 526/1052] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:51.141068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046507-85e3-4291-9fa9-0de64171d6b4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.141466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046507-85e3-4291-9fa9-0de64171d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.141645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046507-85e3-4291-9fa9-0de64171d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.163555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-3d046507-85e3-4291-9fa9-0de64171d6b4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:51.164716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3d046507-85e3-4291-9fa9-0de64171d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:51.227795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 527/1053] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:51.252547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa557e2-f711-47c1-8d04-f60378f74425 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:51.264276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa557e2-f711-47c1-8d04-f60378f74425 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:51.268379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a76260-4df4-4ec0-89f1-729eff7fc9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:51.269089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76260-4df4-4ec0-89f1-729eff7fc9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.269387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76260-4df4-4ec0-89f1-729eff7fc9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.269677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76260-4df4-4ec0-89f1-729eff7fc9e5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.270757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76260-4df4-4ec0-89f1-729eff7fc9e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:51.272462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76260-4df4-4ec0-89f1-729eff7fc9e5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:51.273895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 527/1054] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:51.279776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046507-85e3-4291-9fa9-0de64171d6b4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:51.288138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046507-85e3-4291-9fa9-0de64171d6b4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:51.292308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbba39-9e93-4a12-9f18-ccd2237e666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:51.292889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbba39-9e93-4a12-9f18-ccd2237e666e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:51.293176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbba39-9e93-4a12-9f18-ccd2237e666e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:51.293457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbba39-9e93-4a12-9f18-ccd2237e666e admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:51.294654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbba39-9e93-4a12-9f18-ccd2237e666e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:51.296573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbba39-9e93-4a12-9f18-ccd2237e666e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:51.315586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 528/1055] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:30:51 2022] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:30:53.443839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7764c3-d323-458b-854b-532884faf5b4 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.444407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7764c3-d323-458b-854b-532884faf5b4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.444514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7764c3-d323-458b-854b-532884faf5b4 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.446104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 528/1056] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:53.451951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0368f-6c01-4174-bb2d-3eb528e4af94 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.452347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0368f-6c01-4174-bb2d-3eb528e4af94 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.452530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0368f-6c01-4174-bb2d-3eb528e4af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.474075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5cb0368f-6c01-4174-bb2d-3eb528e4af94 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:53.475234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5cb0368f-6c01-4174-bb2d-3eb528e4af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:53.482404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 529/1057] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:53.506946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7764c3-d323-458b-854b-532884faf5b4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.519354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7764c3-d323-458b-854b-532884faf5b4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.523427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.524172 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.524467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.524755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.536177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:53.542491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:53.543607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 529/1058] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:53.549490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0368f-6c01-4174-bb2d-3eb528e4af94 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.558223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0368f-6c01-4174-bb2d-3eb528e4af94 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.562869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.563450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.563738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.564060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.564773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:53.565070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.566669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:53.575491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 530/1059] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:53.581242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.590530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548687e0-9d2e-4836-a368-d732e583b1d8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.594854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.595642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.595962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.596260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] PATH_INFO: `/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.622318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] RBAC: Authorizing `identity:get_user(user_id=a9a4c6ac3add45dc9472ce5b29e0dc3e)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.624508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:53.626087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 530/1060] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:53.634002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.643675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc658e-f124-4f67-bd53-32a6a12ed26f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.648045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.648620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.648912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.649200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.656942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.658667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:53.667049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 531/1061] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:53.673399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.682868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34777ea5-2b84-41d1-8d95-ba1c331b565b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.687796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ec7db-31bd-41bd-afa4-9c02e6a28b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.688614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec7db-31bd-41bd-afa4-9c02e6a28b17 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.688909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec7db-31bd-41bd-afa4-9c02e6a28b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.689195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec7db-31bd-41bd-afa4-9c02e6a28b17 admin admin] PATH_INFO: `/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.690281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ec7db-31bd-41bd-afa4-9c02e6a28b17 admin admin] RBAC: Authorizing `identity:get_project(project_id=3cc928cf48004c2999961f3ddf9e8c9b)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.692337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ec7db-31bd-41bd-afa4-9c02e6a28b17 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:53.693893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 531/1062] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:53.699756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:53.708235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a87d3-f405-49f6-8522-42f87df2ed34 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:53.712435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01839cbd-1542-4325-b015-0790b89b4b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:53.712994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01839cbd-1542-4325-b015-0790b89b4b00 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:53.713285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01839cbd-1542-4325-b015-0790b89b4b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:53.713570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01839cbd-1542-4325-b015-0790b89b4b00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:53.714342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01839cbd-1542-4325-b015-0790b89b4b00 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=3cc928cf48004c2999961f3ddf9e8c9b, user.id=a9a4c6ac3add45dc9472ce5b29e0dc3e) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:53.714648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01839cbd-1542-4325-b015-0790b89b4b00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:53.716552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01839cbd-1542-4325-b015-0790b89b4b00 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:53.721657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 532/1063] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:53 2022] GET /identity/v3/role_assignments?user.id=a9a4c6ac3add45dc9472ce5b29e0dc3e&scope.project.id=3cc928cf48004c2999961f3ddf9e8c9b&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:55.802033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8891de3-7f4a-4ee1-bf5f-682c2f490d4f None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.802549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8891de3-7f4a-4ee1-bf5f-682c2f490d4f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.802549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8891de3-7f4a-4ee1-bf5f-682c2f490d4f None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:55.804206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 532/1064] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:55.809949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8069a-0432-4f8e-982e-0b4ccf6df97d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.810367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8069a-0432-4f8e-982e-0b4ccf6df97d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.810509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8069a-0432-4f8e-982e-0b4ccf6df97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:55.832494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b5d8069a-0432-4f8e-982e-0b4ccf6df97d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:55.833617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b5d8069a-0432-4f8e-982e-0b4ccf6df97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:55.840465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 533/1065] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:55.863288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8891de3-7f4a-4ee1-bf5f-682c2f490d4f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:55.875667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8891de3-7f4a-4ee1-bf5f-682c2f490d4f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:55.879674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:55.880407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.880697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.880979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:55.891713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:55.897964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:55.899021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 533/1066] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:55.904825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8069a-0432-4f8e-982e-0b4ccf6df97d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:55.913355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8069a-0432-4f8e-982e-0b4ccf6df97d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:55.917609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:55.918198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.919097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.919451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:55.920145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:55.920452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:55.922032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:55.930604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 534/1067] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:55.936892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:55.946294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c8660-ba3a-4069-bee8-1e6a44cb43b0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:55.950922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:55.951684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.952002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.952291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] PATH_INFO: `/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:55.953375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a9a4c6ac3add45dc9472ce5b29e0dc3e)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:55.955480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:55.956952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 534/1068] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:55 2022] GET /identity/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:55.962110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:55.971059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7c9a-0f4e-44df-832a-1619dee317af admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:55.975257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b80d1a-c0b3-447e-a6fe-41d2c3505b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:55.976056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80d1a-c0b3-447e-a6fe-41d2c3505b20 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:55.976350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80d1a-c0b3-447e-a6fe-41d2c3505b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:55.976634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80d1a-c0b3-447e-a6fe-41d2c3505b20 admin admin] PATH_INFO: `/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:55.977713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80d1a-c0b3-447e-a6fe-41d2c3505b20 admin admin] RBAC: Authorizing `identity:get_project(project_id=3cc928cf48004c2999961f3ddf9e8c9b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:55.979704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80d1a-c0b3-447e-a6fe-41d2c3505b20 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:55.981769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 535/1069] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:55 2022] GET /identity/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:55.987031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:55.995944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676214c-aae0-4705-9653-3ad6b50716a5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:56.000692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51e35-a07c-4696-b94b-70ff4b146995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:56.001474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51e35-a07c-4696-b94b-70ff4b146995 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:56.001765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51e35-a07c-4696-b94b-70ff4b146995 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:56.002049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51e35-a07c-4696-b94b-70ff4b146995 admin admin] PATH_INFO: `/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b/users/a9a4c6ac3add45dc9472ce5b29e0dc3e/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:56.003812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec51e35-a07c-4696-b94b-70ff4b146995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc928cf48004c2999961f3ddf9e8c9b, user_id=a9a4c6ac3add45dc9472ce5b29e0dc3e, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:56.006393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec51e35-a07c-4696-b94b-70ff4b146995 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:56.018644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 535/1070] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:30:55 2022] PUT /identity/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b/users/a9a4c6ac3add45dc9472ce5b29e0dc3e/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:30:58.094474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f929-5cdd-45b1-a927-b9e63df65002 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.095043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f929-5cdd-45b1-a927-b9e63df65002 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.095043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14f929-5cdd-45b1-a927-b9e63df65002 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.096758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 536/1071] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:30:58.101907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c058899-7e1c-4847-8475-bd8f79824db8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.102322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c058899-7e1c-4847-8475-bd8f79824db8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.102482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c058899-7e1c-4847-8475-bd8f79824db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.127087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-9c058899-7e1c-4847-8475-bd8f79824db8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:30:58.128254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9c058899-7e1c-4847-8475-bd8f79824db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:30:58.191413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 536/1072] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:30:58 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:30:58.214723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f929-5cdd-45b1-a927-b9e63df65002 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.226731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14f929-5cdd-45b1-a927-b9e63df65002 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.231376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.232187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.232473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.232760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.243968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:30:58.251024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:30:58.252122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 537/1073] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:30:58.258114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c058899-7e1c-4847-8475-bd8f79824db8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.266685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c058899-7e1c-4847-8475-bd8f79824db8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.270868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.271456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.271749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.272069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.272788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:58.273092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.274691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:58.283025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 537/1074] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:58.288910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.299311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dfc34-8dfa-40da-a676-482b615c5ad7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.303859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.304690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.304978 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.305263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] PATH_INFO: `/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.306380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] RBAC: Authorizing `identity:get_user(user_id=a9a4c6ac3add45dc9472ce5b29e0dc3e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.308538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:58.310785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 538/1075] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:30:58.316815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.326297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c1f7-0e43-4034-bdbd-80d18b8301e1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.330498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.331066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.331363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.331648 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.339183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.340975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:58.349354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 538/1076] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:30:58.354833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.364599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64686-61ac-4928-ad4c-19f99d38efcb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.368865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c389d5-0e5d-4458-9647-a57c97832e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.369629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c389d5-0e5d-4458-9647-a57c97832e9f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.369916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c389d5-0e5d-4458-9647-a57c97832e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.370198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c389d5-0e5d-4458-9647-a57c97832e9f admin admin] PATH_INFO: `/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.371267 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c389d5-0e5d-4458-9647-a57c97832e9f admin admin] RBAC: Authorizing `identity:get_project(project_id=3cc928cf48004c2999961f3ddf9e8c9b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.373940 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c389d5-0e5d-4458-9647-a57c97832e9f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:58.375469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 539/1077] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:30:58.381212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:30:58.389924 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20d309-1e7e-4f30-b7fc-fcbc1fb1db66 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:30:58.394105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea65d44-2ffe-4378-91b6-2340aa77ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:30:58.394659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65d44-2ffe-4378-91b6-2340aa77ce37 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:30:58.394949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65d44-2ffe-4378-91b6-2340aa77ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:30:58.395234 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea65d44-2ffe-4378-91b6-2340aa77ce37 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:30:58.396029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65d44-2ffe-4378-91b6-2340aa77ce37 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=3cc928cf48004c2999961f3ddf9e8c9b, user.id=a9a4c6ac3add45dc9472ce5b29e0dc3e) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:30:58.396337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65d44-2ffe-4378-91b6-2340aa77ce37 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:30:58.398113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea65d44-2ffe-4378-91b6-2340aa77ce37 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:30:58.404193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 539/1078] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:30:58 2022] GET /identity/v3/role_assignments?user.id=a9a4c6ac3add45dc9472ce5b29e0dc3e&scope.project.id=3cc928cf48004c2999961f3ddf9e8c9b&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:00.508600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44d33-c5cb-417c-9aa8-e75c715e0c02 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:00.509143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44d33-c5cb-417c-9aa8-e75c715e0c02 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:00.509143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44d33-c5cb-417c-9aa8-e75c715e0c02 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:00.510840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 540/1079] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:00.516715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fe0e-8fc1-455c-8c69-dde209dbf2e6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:00.517116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fe0e-8fc1-455c-8c69-dde209dbf2e6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:00.517296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478fe0e-8fc1-455c-8c69-dde209dbf2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:00.539724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4478fe0e-8fc1-455c-8c69-dde209dbf2e6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:00.540902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4478fe0e-8fc1-455c-8c69-dde209dbf2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:00.548122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 540/1080] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:00 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:00.570613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44d33-c5cb-417c-9aa8-e75c715e0c02 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:00.583098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44d33-c5cb-417c-9aa8-e75c715e0c02 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:00.587159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:00.587732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:00.588058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:00.588350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:00.596606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:00.598360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:00.606842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 541/1081] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:00 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:31:00.612400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478fe0e-8fc1-455c-8c69-dde209dbf2e6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:00.620721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478fe0e-8fc1-455c-8c69-dde209dbf2e6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:00.625016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b4f2-bab4-4d06-ba84-88f53d9c61cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:00.625737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b4f2-bab4-4d06-ba84-88f53d9c61cc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:00.626028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b4f2-bab4-4d06-ba84-88f53d9c61cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:00.626314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b4f2-bab4-4d06-ba84-88f53d9c61cc admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:00.634149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b4f2-bab4-4d06-ba84-88f53d9c61cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:00.635991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b4f2-bab4-4d06-ba84-88f53d9c61cc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:00.650332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-1592b4f2-bab4-4d06-ba84-88f53d9c61cc admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 08 02:31:00.651369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 541/1082] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:31:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:00.657862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:00.666207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b74496-2987-4251-985f-a44b4bf87556 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:00.670661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70316d5d-394a-4ac5-9aca-517c126df89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:00.671229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316d5d-394a-4ac5-9aca-517c126df89f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:00.671522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316d5d-394a-4ac5-9aca-517c126df89f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:00.671809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70316d5d-394a-4ac5-9aca-517c126df89f admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:00.672529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70316d5d-394a-4ac5-9aca-517c126df89f admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:31:00.672835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70316d5d-394a-4ac5-9aca-517c126df89f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:00.674384 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70316d5d-394a-4ac5-9aca-517c126df89f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:00.682452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 542/1083] 10.222.0.23 () {56 vars in 1136 bytes} [Fri Apr 8 02:31:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:02.780034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc160f-697f-4886-933e-e895d7a18596 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:02.780538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc160f-697f-4886-933e-e895d7a18596 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:02.780538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc160f-697f-4886-933e-e895d7a18596 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:02.782212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 542/1084] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:02.787310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7cc7a-95f7-4adb-92ff-d34d3b6dc3ae None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:02.787749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7cc7a-95f7-4adb-92ff-d34d3b6dc3ae None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:02.787885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7cc7a-95f7-4adb-92ff-d34d3b6dc3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:02.811035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a6a7cc7a-95f7-4adb-92ff-d34d3b6dc3ae None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:02.812200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a6a7cc7a-95f7-4adb-92ff-d34d3b6dc3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:02.819001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 543/1085] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:02 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:02.842167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc160f-697f-4886-933e-e895d7a18596 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:02.853993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc160f-697f-4886-933e-e895d7a18596 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:02.859007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f1bff-5c97-4756-ab11-861c14b037a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:02.859586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f1bff-5c97-4756-ab11-861c14b037a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:02.859883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f1bff-5c97-4756-ab11-861c14b037a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:02.860202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f1bff-5c97-4756-ab11-861c14b037a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:02.860909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f1bff-5c97-4756-ab11-861c14b037a3 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:02.861905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-dc8f1bff-5c97-4756-ab11-861c14b037a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:31:02.861905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:31:02.861905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:31:02.862782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f1bff-5c97-4756-ab11-861c14b037a3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:02.877458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 543/1086] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Apr 8 02:31:02 2022] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:31:05.002561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89028a07-b7a0-438c-aeaa-7be48fd9cec9 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:05.003151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89028a07-b7a0-438c-aeaa-7be48fd9cec9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:05.003151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89028a07-b7a0-438c-aeaa-7be48fd9cec9 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:05.004836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 544/1087] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:05.010021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f449-5e80-495b-a313-b22966736f65 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:05.010404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f449-5e80-495b-a313-b22966736f65 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:05.010598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f449-5e80-495b-a313-b22966736f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:05.032705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1479f449-5e80-495b-a313-b22966736f65 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:05.033846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1479f449-5e80-495b-a313-b22966736f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:05.096324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 544/1088] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:05 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:05.119730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89028a07-b7a0-438c-aeaa-7be48fd9cec9 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:05.131637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89028a07-b7a0-438c-aeaa-7be48fd9cec9 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:05.135659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea80c-f0f2-47df-9faf-eba91f0e9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:05.137041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea80c-f0f2-47df-9faf-eba91f0e9157 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:05.137548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea80c-f0f2-47df-9faf-eba91f0e9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:05.137666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea80c-f0f2-47df-9faf-eba91f0e9157 admin admin] PATH_INFO: `/v3/domains/40b6606744a84670b86122a38a20ff05` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:05.149222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea80c-f0f2-47df-9faf-eba91f0e9157 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=40b6606744a84670b86122a38a20ff05)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:05.151158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea80c-f0f2-47df-9faf-eba91f0e9157 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:05.153206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 545/1089] 10.222.0.23 () {56 vars in 1204 bytes} [Fri Apr 8 02:31:05 2022] GET /identity/v3/domains/40b6606744a84670b86122a38a20ff05 => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:05.158722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f449-5e80-495b-a313-b22966736f65 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:05.167164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f449-5e80-495b-a313-b22966736f65 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:05.171491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5a4fd-e247-4f19-9a50-8156d9702965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:05.172112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a4fd-e247-4f19-9a50-8156d9702965 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:05.172408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a4fd-e247-4f19-9a50-8156d9702965 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:05.172696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5a4fd-e247-4f19-9a50-8156d9702965 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:05.173349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a4fd-e247-4f19-9a50-8156d9702965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:05.175225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5a4fd-e247-4f19-9a50-8156d9702965 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:05.202117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 545/1090] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:31:05 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:31:07.343364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071cd9-f124-4491-8018-c092783757c3 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:07.344008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071cd9-f124-4491-8018-c092783757c3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:07.344008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc071cd9-f124-4491-8018-c092783757c3 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:07.345636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 546/1091] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:07.350768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb694-c23a-4c50-ac2d-fb5ea58d7f2a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:07.351147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb694-c23a-4c50-ac2d-fb5ea58d7f2a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:07.351337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eb694-c23a-4c50-ac2d-fb5ea58d7f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:07.374314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d78eb694-c23a-4c50-ac2d-fb5ea58d7f2a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:07.375491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d78eb694-c23a-4c50-ac2d-fb5ea58d7f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:07.438318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 546/1092] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:07.463337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071cd9-f124-4491-8018-c092783757c3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:07.476305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc071cd9-f124-4491-8018-c092783757c3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:07.480298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221189f-1d5a-40eb-9867-31380949f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:07.481522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221189f-1d5a-40eb-9867-31380949f919 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:07.481809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221189f-1d5a-40eb-9867-31380949f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:07.482094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221189f-1d5a-40eb-9867-31380949f919 admin admin] PATH_INFO: `/v3/domains/40b6606744a84670b86122a38a20ff05` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:07.483171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221189f-1d5a-40eb-9867-31380949f919 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=40b6606744a84670b86122a38a20ff05)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:07.485121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221189f-1d5a-40eb-9867-31380949f919 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:07.486547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 547/1093] 10.222.0.23 () {56 vars in 1204 bytes} [Fri Apr 8 02:31:07 2022] GET /identity/v3/domains/40b6606744a84670b86122a38a20ff05 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:07.492259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eb694-c23a-4c50-ac2d-fb5ea58d7f2a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:07.501453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eb694-c23a-4c50-ac2d-fb5ea58d7f2a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:07.505687 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a5413-45a9-44d6-8df1-d19a845a0120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:07.506275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5413-45a9-44d6-8df1-d19a845a0120 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:07.506567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5413-45a9-44d6-8df1-d19a845a0120 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:07.506854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a5413-45a9-44d6-8df1-d19a845a0120 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:07.507530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a5413-45a9-44d6-8df1-d19a845a0120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:07.509453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a5413-45a9-44d6-8df1-d19a845a0120 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:07.530064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 547/1094] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:31:07 2022] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:31:09.674805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef576-0185-4f3b-a905-8ca8ebc88612 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.675324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef576-0185-4f3b-a905-8ca8ebc88612 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.675443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ef576-0185-4f3b-a905-8ca8ebc88612 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.677314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 548/1095] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:09.682616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec151b2-4209-47c1-b8e2-303c624ea231 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.683035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec151b2-4209-47c1-b8e2-303c624ea231 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.683188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec151b2-4209-47c1-b8e2-303c624ea231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.706741 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-9ec151b2-4209-47c1-b8e2-303c624ea231 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:09.707890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9ec151b2-4209-47c1-b8e2-303c624ea231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:09.715383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 548/1096] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:09 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:09.739259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef576-0185-4f3b-a905-8ca8ebc88612 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:09.750971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ef576-0185-4f3b-a905-8ca8ebc88612 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:09.755023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:09.755723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.756043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.756327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.767509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:31:09.773733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:09.774783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 549/1097] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:31:09.781547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec151b2-4209-47c1-b8e2-303c624ea231 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:09.789980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec151b2-4209-47c1-b8e2-303c624ea231 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:09.794848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:09.795430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.795722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.796047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.796761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:31:09.797065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:09.798635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:09.807142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 549/1098] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:09.812592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:09.822033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691815-fec0-44a6-a2df-80c5c4815938 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:09.826325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:09.827088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.827374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.827658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] PATH_INFO: `/v3/users/3c845bc69ded4b81b773f953bf3eae2d` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.845704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c845bc69ded4b81b773f953bf3eae2d)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:09.847799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:09.849291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 550/1099] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:31:09 2022] GET /identity/v3/users/3c845bc69ded4b81b773f953bf3eae2d => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:09.854662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:09.864410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223a0cd-af9a-4341-b5f2-f67fafee8d77 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:09.868659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:09.869221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.869513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.869799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.878553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:09.880557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:09.891966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 550/1100] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:09 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:31:09.899793 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:09.910658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558d80-7207-4206-88a8-40f3549fa1c6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:09.916241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d30f7d-cb4f-44d8-b01f-075769566ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:09.917034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30f7d-cb4f-44d8-b01f-075769566ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.917329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30f7d-cb4f-44d8-b01f-075769566ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.917620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d30f7d-cb4f-44d8-b01f-075769566ae9 admin admin] PATH_INFO: `/v3/projects/b1ef151b81c542ee8448775f8b547988` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.919788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30f7d-cb4f-44d8-b01f-075769566ae9 admin admin] RBAC: Authorizing `identity:get_project(project_id=b1ef151b81c542ee8448775f8b547988)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:09.922852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d30f7d-cb4f-44d8-b01f-075769566ae9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:09.924444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 551/1101] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:31:09 2022] GET /identity/v3/projects/b1ef151b81c542ee8448775f8b547988 => generated 361 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:31:09.930917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:09.940941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987edad-8acc-433d-8ae5-f5ef28853e8f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:09.945036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8180a-fd80-4dfc-81c8-c0f5b4118de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:09.945565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8180a-fd80-4dfc-81c8-c0f5b4118de6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:09.945826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8180a-fd80-4dfc-81c8-c0f5b4118de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:09.946118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8180a-fd80-4dfc-81c8-c0f5b4118de6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:09.947126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8180a-fd80-4dfc-81c8-c0f5b4118de6 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=b1ef151b81c542ee8448775f8b547988, user.id=3c845bc69ded4b81b773f953bf3eae2d) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:31:09.947228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8180a-fd80-4dfc-81c8-c0f5b4118de6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:09.949098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8180a-fd80-4dfc-81c8-c0f5b4118de6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:09.954461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 551/1102] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:09 2022] GET /identity/v3/role_assignments?user.id=3c845bc69ded4b81b773f953bf3eae2d&scope.project.id=b1ef151b81c542ee8448775f8b547988&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:12.014629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b832e-5590-466a-901e-ba9c75a78559 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:12.015185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b832e-5590-466a-901e-ba9c75a78559 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:12.015185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b832e-5590-466a-901e-ba9c75a78559 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:12.016903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 552/1103] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:12.022118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290be1-3e23-41c0-979b-44731f4192b9 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:12.022556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290be1-3e23-41c0-979b-44731f4192b9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:12.022701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290be1-3e23-41c0-979b-44731f4192b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:12.045328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-ba290be1-3e23-41c0-979b-44731f4192b9 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:12.046468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ba290be1-3e23-41c0-979b-44731f4192b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:12.053666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 552/1104] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:12.075979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b832e-5590-466a-901e-ba9c75a78559 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:12.087564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b832e-5590-466a-901e-ba9c75a78559 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:12.092244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:12.092973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:12.093261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:12.093543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:12.104379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:31:12.111233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:12.112323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 553/1105] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:12.118080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba290be1-3e23-41c0-979b-44731f4192b9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:12.126523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba290be1-3e23-41c0-979b-44731f4192b9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:12.130730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:12.131308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:12.131603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:12.131889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:12.132644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:31:12.132947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:12.134522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:12.142737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 553/1106] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:12.148075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:12.158461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5308c-46f6-417c-a547-6c7e808046bf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:12.162691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:12.163462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:12.163750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:12.164067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] PATH_INFO: `/v3/users/3c845bc69ded4b81b773f953bf3eae2d` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:12.165149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] RBAC: Authorizing `identity:get_user(user_id=3c845bc69ded4b81b773f953bf3eae2d)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:12.167234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:12.169556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 554/1107] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:31:12 2022] GET /identity/v3/users/3c845bc69ded4b81b773f953bf3eae2d => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:12.174749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:12.184240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a067b-3421-42b5-b8ef-24b79e5f711e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:12.188509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b1217-5c46-4f1d-9124-713819b560ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:12.189267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1217-5c46-4f1d-9124-713819b560ed admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:12.189556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1217-5c46-4f1d-9124-713819b560ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:12.189837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1217-5c46-4f1d-9124-713819b560ed admin admin] PATH_INFO: `/v3/projects/b1ef151b81c542ee8448775f8b547988` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:12.190912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b1217-5c46-4f1d-9124-713819b560ed admin admin] RBAC: Authorizing `identity:get_project(project_id=b1ef151b81c542ee8448775f8b547988)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:12.192921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b1217-5c46-4f1d-9124-713819b560ed admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:12.194536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 554/1108] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:31:12 2022] GET /identity/v3/projects/b1ef151b81c542ee8448775f8b547988 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:12.200458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:12.209392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094e3c4-8b30-4917-b983-df0d40f2c9ac admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:12.213551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e2377-75b1-496e-86e1-92abbe31c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:12.214325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e2377-75b1-496e-86e1-92abbe31c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:12.215574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e2377-75b1-496e-86e1-92abbe31c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:12.215864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e2377-75b1-496e-86e1-92abbe31c40e admin admin] PATH_INFO: `/v3/projects/b1ef151b81c542ee8448775f8b547988/users/3c845bc69ded4b81b773f953bf3eae2d/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:12.217622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e2377-75b1-496e-86e1-92abbe31c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ef151b81c542ee8448775f8b547988, user_id=3c845bc69ded4b81b773f953bf3eae2d, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:12.220229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e2377-75b1-496e-86e1-92abbe31c40e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:12.233491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 555/1109] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:31:12 2022] PUT /identity/v3/projects/b1ef151b81c542ee8448775f8b547988/users/3c845bc69ded4b81b773f953bf3eae2d/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:31:14.333600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba1c76-9dab-4e15-8fe5-15df5a022d57 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.334156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba1c76-9dab-4e15-8fe5-15df5a022d57 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.334156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba1c76-9dab-4e15-8fe5-15df5a022d57 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.335840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 555/1110] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:31:14.341664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807228-26fb-4abd-81bf-2e0336a11b95 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.342094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807228-26fb-4abd-81bf-2e0336a11b95 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.342245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1807228-26fb-4abd-81bf-2e0336a11b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.364204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b1807228-26fb-4abd-81bf-2e0336a11b95 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:31:14.365341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b1807228-26fb-4abd-81bf-2e0336a11b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:31:14.428838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 556/1111] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:31:14.451867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba1c76-9dab-4e15-8fe5-15df5a022d57 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:14.463419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba1c76-9dab-4e15-8fe5-15df5a022d57 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:14.468279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:14.469004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.469297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.469586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.481550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:31:14.487807 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:31:14.488921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 556/1112] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:31:14.494918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807228-26fb-4abd-81bf-2e0336a11b95 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:14.503572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1807228-26fb-4abd-81bf-2e0336a11b95 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:14.507791 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:14.508429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.508721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.509004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.509720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:31:14.510026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:14.511744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:14.520226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 557/1113] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:14.525545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:14.535193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19773a-02ef-459e-8389-979ea6193d56 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:14.539392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:14.540200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.540492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.540773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] PATH_INFO: `/v3/users/3c845bc69ded4b81b773f953bf3eae2d` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.541861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] RBAC: Authorizing `identity:get_user(user_id=3c845bc69ded4b81b773f953bf3eae2d)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:14.544772 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:14.546200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 557/1114] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:31:14 2022] GET /identity/v3/users/3c845bc69ded4b81b773f953bf3eae2d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:14.551560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:14.560818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bed155-7ec5-42e3-95cd-12b1709b0eaf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:14.564975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:14.565530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.565844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.566128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.573571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:14.575855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:14.584218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 558/1115] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:31:14 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:31:14.590058 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:14.599015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5efee-6877-49de-8010-d06a1120705f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:14.603170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4ef0a-dfcd-4511-99ec-63af42f5eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:14.603916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4ef0a-dfcd-4511-99ec-63af42f5eeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.604237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4ef0a-dfcd-4511-99ec-63af42f5eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.604524 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4ef0a-dfcd-4511-99ec-63af42f5eeb0 admin admin] PATH_INFO: `/v3/projects/b1ef151b81c542ee8448775f8b547988` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.605607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4ef0a-dfcd-4511-99ec-63af42f5eeb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b1ef151b81c542ee8448775f8b547988)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:14.607570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4ef0a-dfcd-4511-99ec-63af42f5eeb0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:14.609086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 558/1116] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:31:14 2022] GET /identity/v3/projects/b1ef151b81c542ee8448775f8b547988 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:31:14.614693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:31:14.623182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39808-444e-41a6-b735-fa6491621c66 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:31:14.627467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b5672-d5c8-4e0f-83ff-2369ee6cf837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:31:14.628059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5672-d5c8-4e0f-83ff-2369ee6cf837 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:31:14.628358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5672-d5c8-4e0f-83ff-2369ee6cf837 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:31:14.628649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5672-d5c8-4e0f-83ff-2369ee6cf837 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:31:14.629424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5672-d5c8-4e0f-83ff-2369ee6cf837 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=b1ef151b81c542ee8448775f8b547988, user.id=3c845bc69ded4b81b773f953bf3eae2d) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:31:14.629734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5672-d5c8-4e0f-83ff-2369ee6cf837 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:31:14.631514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5672-d5c8-4e0f-83ff-2369ee6cf837 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:31:14.637590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 559/1117] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:31:14 2022] GET /identity/v3/role_assignments?user.id=3c845bc69ded4b81b773f953bf3eae2d&scope.project.id=b1ef151b81c542ee8448775f8b547988&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:50.951485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7391-1bd8-45ec-b71a-5c7c6a30f471 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:50.952099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7391-1bd8-45ec-b71a-5c7c6a30f471 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:50.952099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da7391-1bd8-45ec-b71a-5c7c6a30f471 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:50.953759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 559/1118] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:50.959179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575323ca-9b35-4cc9-b719-30ffc9435214 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:50.959603 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575323ca-9b35-4cc9-b719-30ffc9435214 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:50.959743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575323ca-9b35-4cc9-b719-30ffc9435214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:50.983292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-575323ca-9b35-4cc9-b719-30ffc9435214 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:50.984460 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-575323ca-9b35-4cc9-b719-30ffc9435214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:50.992456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 560/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:51.016529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7391-1bd8-45ec-b71a-5c7c6a30f471 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:51.028192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da7391-1bd8-45ec-b71a-5c7c6a30f471 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:51.032283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:51.032984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:51.033276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:51.033563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:51.045756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:51.047576 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:51.064945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:32:51.066150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 560/1120] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:51.072317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575323ca-9b35-4cc9-b719-30ffc9435214 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:51.080844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575323ca-9b35-4cc9-b719-30ffc9435214 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:51.085321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd1a24-f360-450c-90d0-9b27703a0424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:51.085905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd1a24-f360-450c-90d0-9b27703a0424 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:51.086193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd1a24-f360-450c-90d0-9b27703a0424 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:51.086475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd1a24-f360-450c-90d0-9b27703a0424 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:51.087165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd1a24-f360-450c-90d0-9b27703a0424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:51.087467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd1a24-f360-450c-90d0-9b27703a0424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:51.089111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd1a24-f360-450c-90d0-9b27703a0424 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:51.101597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 561/1121] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:51.107197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:51.116854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9bac18-9844-4bb8-8be9-f204570a8fde admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:51.121129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e3f23-c0e2-4e26-ba40-cf94c5d02761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:51.121708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3f23-c0e2-4e26-ba40-cf94c5d02761 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:51.121996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3f23-c0e2-4e26-ba40-cf94c5d02761 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:51.122279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e3f23-c0e2-4e26-ba40-cf94c5d02761 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:51.122928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3f23-c0e2-4e26-ba40-cf94c5d02761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:51.124833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e3f23-c0e2-4e26-ba40-cf94c5d02761 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:51.145107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 561/1122] 10.222.0.23 () {60 vars in 1153 bytes} [Fri Apr 8 02:32:51 2022] POST /identity/v3/users => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:32:53.281549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff8d0-a014-46ef-802c-9ee2075b7411 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.282111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff8d0-a014-46ef-802c-9ee2075b7411 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.282111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ff8d0-a014-46ef-802c-9ee2075b7411 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.283792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 562/1123] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:53.289069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ce8f-e4ac-43b4-8bdf-df874eef3f7c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.289453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ce8f-e4ac-43b4-8bdf-df874eef3f7c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.289656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8ce8f-e4ac-43b4-8bdf-df874eef3f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.311581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7fa8ce8f-e4ac-43b4-8bdf-df874eef3f7c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:53.312765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7fa8ce8f-e4ac-43b4-8bdf-df874eef3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:53.320464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 562/1124] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:53 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:53.344120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff8d0-a014-46ef-802c-9ee2075b7411 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.355914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ff8d0-a014-46ef-802c-9ee2075b7411 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.359965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.360675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.360966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.361251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.372763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:32:53.379696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:32:53.380791 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 563/1125] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:53.386623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ce8f-e4ac-43b4-8bdf-df874eef3f7c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.395125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8ce8f-e4ac-43b4-8bdf-df874eef3f7c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.400858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.401577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.401902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.402320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.403214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:53.403607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.405699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.416691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 563/1126] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:53.424274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.437055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec0cc9-7163-4733-a0a9-ee11fb31e852 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.443763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.444771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.445261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.445553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.459435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.461782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.482705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:32:53.484443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 564/1127] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:53.492613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.504517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc607cb-f439-46b9-ad53-2f9af67cc38d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.508814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.509397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.509691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.509979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.510670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:53.510977 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.512605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.524702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 564/1128] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:32:53.530448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.539905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ebbac-d421-4781-9ea1-59f0b90a4a08 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.544042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.544763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.545051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.545335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.558774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.560795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.578735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:32:53.579768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 565/1129] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:53.585890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.594961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae5fce-e7bf-4061-898a-51bca09eb21f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.599695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.600314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.600607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.600890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.601672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:53.601973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.603784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.632891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 565/1130] 10.222.0.23 () {56 vars in 1164 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:53.638746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.648129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2edd-a991-4f72-8ed8-21094c6cc25e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.652269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.652824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.653112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.653395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.661301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.662995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.671744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 566/1131] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:53.678485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.687627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbebda-5e71-4fd8-aca0-fc8d4c53d91a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.692666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.693377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.693674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.693965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.705286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.707209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.724180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:32:53.725229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 566/1132] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:53.730769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.739684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ef0e7-6c28-4862-bb39-19f9896b95b0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.743877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.744477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.744763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.745043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.745718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:53.746015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.747537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.760273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 567/1133] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:53.765637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.774801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5b004-c070-4cde-a26c-2eab24171778 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.779038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.779739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.780070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.780361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.789219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.791203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.807998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:32:53.809051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 567/1134] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:53.814660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.823864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3c316-f217-430b-881d-e35ebe4f1e80 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.828109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b642e0-ccde-407a-9143-708ff0cd995c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.828685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b642e0-ccde-407a-9143-708ff0cd995c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.828975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b642e0-ccde-407a-9143-708ff0cd995c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.829260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b642e0-ccde-407a-9143-708ff0cd995c admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.830000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b642e0-ccde-407a-9143-708ff0cd995c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:53.830305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b642e0-ccde-407a-9143-708ff0cd995c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.832163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b642e0-ccde-407a-9143-708ff0cd995c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.844511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 568/1135] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:53.850883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:53.859994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872ec4-04f6-4898-b189-362764436e6d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:53.866085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66873ec-b74c-4f28-92c0-11ad7512f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:53.866668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66873ec-b74c-4f28-92c0-11ad7512f3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:53.867041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66873ec-b74c-4f28-92c0-11ad7512f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:53.867537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66873ec-b74c-4f28-92c0-11ad7512f3d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:53.868708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66873ec-b74c-4f28-92c0-11ad7512f3d0 admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=9ed63325027545d1bb46f1031a736089) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:53.869243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66873ec-b74c-4f28-92c0-11ad7512f3d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:53.871803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66873ec-b74c-4f28-92c0-11ad7512f3d0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:53.877342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 568/1136] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:53 2022] GET /identity/v3/role_assignments?user.id=9ed63325027545d1bb46f1031a736089&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:55.955075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158692b-341e-4950-8d8f-00e61ff3776e None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:55.955635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158692b-341e-4950-8d8f-00e61ff3776e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:55.955635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158692b-341e-4950-8d8f-00e61ff3776e None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:55.957868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 569/1137] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:55.962898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2132-f8f3-4516-ba7c-91c02a11ca5c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:55.963293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2132-f8f3-4516-ba7c-91c02a11ca5c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:55.963471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d2132-f8f3-4516-ba7c-91c02a11ca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:55.985771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-458d2132-f8f3-4516-ba7c-91c02a11ca5c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:55.986899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-458d2132-f8f3-4516-ba7c-91c02a11ca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:55.994547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 569/1138] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:56.017106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158692b-341e-4950-8d8f-00e61ff3776e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.028991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158692b-341e-4950-8d8f-00e61ff3776e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.033023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.033728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.034509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.035325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.047331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:32:56.054586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:32:56.055678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 570/1139] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:56.061598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d2132-f8f3-4516-ba7c-91c02a11ca5c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.070675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d2132-f8f3-4516-ba7c-91c02a11ca5c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.074842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.075423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.075714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.076031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.076744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:56.077046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.078615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.086773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 570/1140] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:56.092259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.102634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daad845-a265-4d9b-a593-83aa392b95c2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.106808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.107498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.107786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.108097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.119409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.121220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.138638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:32:56.139653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 571/1141] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:56.145871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.154962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6802c0-ef4e-4f22-99ae-e99a01c34297 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.159195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.159844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.160170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.160464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.161157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:56.161464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.163043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.176582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 571/1142] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:32:56.182391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.192334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc0526-8908-4c43-9bf2-b335418636ed admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.196523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.197228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.197518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.197801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.210693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.212668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.230053 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:32:56.231096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 572/1143] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:56.236641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.245668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eefe6-8483-42e0-a2e4-67c63a8fce1a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.249904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.250482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.250783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.251066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.251852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:56.252190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.254919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.283180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 572/1144] 10.222.0.23 () {56 vars in 1164 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:56.288687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.297798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42cf1-f7da-4c3d-b52a-3c166d82d1c4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.302579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.303282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.303571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.303854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.315963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.317780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.335254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:32:56.336360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 573/1145] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:56.341923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.351238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2672fe-b72c-4ac1-ad6b-b5be2eb7d7ca admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.355479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.356103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.356401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.356691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.357412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:56.357719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.359293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.372009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 573/1146] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:56.377424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.387595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c7ee-3966-4fca-94d6-8bcfd0f88e29 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.391714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.392444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.392732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.393012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.403815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.406089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.421988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:32:56.423207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 574/1147] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:56.430547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.441827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c83e52-44bf-4096-afb2-708a287e1dfb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.447136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54887b-3bf7-4574-a70b-c9bb909f1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.447717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54887b-3bf7-4574-a70b-c9bb909f1417 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.448106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54887b-3bf7-4574-a70b-c9bb909f1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.448411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54887b-3bf7-4574-a70b-c9bb909f1417 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.449229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54887b-3bf7-4574-a70b-c9bb909f1417 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:56.449577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54887b-3bf7-4574-a70b-c9bb909f1417 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.451403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54887b-3bf7-4574-a70b-c9bb909f1417 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.471242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 574/1148] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:32:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:56.472202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:56.481604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94551dd-c2c9-40ac-8bbe-430fe873c8b9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:56.485982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0cb33-2a1e-400b-b98f-6069ad6859be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:56.486791 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0cb33-2a1e-400b-b98f-6069ad6859be admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:56.487089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0cb33-2a1e-400b-b98f-6069ad6859be admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:56.487866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0cb33-2a1e-400b-b98f-6069ad6859be admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/9ed63325027545d1bb46f1031a736089/roles/58f38def815542948bd51acfd4644ea3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:56.507293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0cb33-2a1e-400b-b98f-6069ad6859be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=9ed63325027545d1bb46f1031a736089, role_id=58f38def815542948bd51acfd4644ea3)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:56.509946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0cb33-2a1e-400b-b98f-6069ad6859be admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:56.522898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 575/1149] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:32:56 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/9ed63325027545d1bb46f1031a736089/roles/58f38def815542948bd51acfd4644ea3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:32:58.652419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e018f-80f9-42bd-86e8-3f8463e5a57f None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:58.652944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e018f-80f9-42bd-86e8-3f8463e5a57f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:58.653062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e018f-80f9-42bd-86e8-3f8463e5a57f None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:58.654670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 575/1150] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:32:58.660020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a6684-fa1e-4966-be02-cbacaffcda25 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:58.660440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a6684-fa1e-4966-be02-cbacaffcda25 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:58.660602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a6684-fa1e-4966-be02-cbacaffcda25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:58.684388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-975a6684-fa1e-4966-be02-cbacaffcda25 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:32:58.685537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-975a6684-fa1e-4966-be02-cbacaffcda25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:32:58.749252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 576/1151] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:32:58 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:32:58.773770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e018f-80f9-42bd-86e8-3f8463e5a57f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:58.785730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e018f-80f9-42bd-86e8-3f8463e5a57f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:58.789728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:58.790436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:58.790727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:58.791011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:58.802908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:32:58.809249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 08 02:32:58.810309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 576/1152] 10.222.0.23 () {56 vars in 1123 bytes} [Fri Apr 8 02:32:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:58.816644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a6684-fa1e-4966-be02-cbacaffcda25 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:58.825151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a6684-fa1e-4966-be02-cbacaffcda25 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:58.829364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:58.829952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:58.830247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:58.830534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:58.831399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:58.831772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:58.833407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:58.841927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 577/1153] 10.222.0.23 () {56 vars in 1124 bytes} [Fri Apr 8 02:32:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:58.847975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:58.857365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210dbc0-c9b9-4cf0-b356-27b347696c43 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:58.861495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:58.865572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:58.865888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:58.866263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:58.877613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:58.880017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:58.896908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:32:58.897962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 577/1154] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:58.903597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:58.913123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313bba-ed83-4c50-a6fc-899041b09f98 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:58.917369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:58.917949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:58.918243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:58.918529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:58.919224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:58.919530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:58.921140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:58.934530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 578/1155] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:58.940042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:58.949686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c813c65-fd97-4e03-a091-98e1a64f5c29 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:58.953893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:58.954601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:58.954894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:58.955179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:58.968129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:58.970116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:58.988406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:32:58.989439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 578/1156] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:58.994982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:59.004658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4cc97-de69-470d-b048-4e5b1b47c1a4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:59.008831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:59.009516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:59.009816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:59.010105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:59.010894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:59.011201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:59.013045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:59.041276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 579/1157] 10.222.0.23 () {56 vars in 1164 bytes} [Fri Apr 8 02:32:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:59.047240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:59.056885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf3a13-cb79-4209-a961-4adc1fb56467 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:59.061046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:59.061602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:59.061894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:59.062179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:59.070337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:59.072091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:59.081547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 579/1158] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:32:59 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:32:59.086748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:59.095714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6176200-3d9c-4520-83d3-20bfa4e150f6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:59.100864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:59.101566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:59.101856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:59.102139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:59.114114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:59.115906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:59.132378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:32:59.133438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 580/1159] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:59.139536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:59.148089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bb429-32e9-49c7-8bdd-4d4fc9cf9898 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:59.152358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:59.152936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:59.153231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:59.153518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:59.154199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:59.154504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:59.156215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:59.168701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 580/1160] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:59.174365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:59.184404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704943dd-1f11-4b4a-97fa-048e00849509 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:59.188516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:59.189214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:59.189498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:59.189776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:59.198108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:59.200065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:59.213294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:32:59.214318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 581/1161] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:32:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:32:59.220003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:59.229637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28d32f-9239-4fbb-9237-53195e698d28 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:59.233876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0ed3-a187-42ea-a5e4-4dc917d67c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:59.234444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0ed3-a187-42ea-a5e4-4dc917d67c19 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:59.234737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0ed3-a187-42ea-a5e4-4dc917d67c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:59.235025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0ed3-a187-42ea-a5e4-4dc917d67c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:59.235766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0ed3-a187-42ea-a5e4-4dc917d67c19 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:59.236105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0ed3-a187-42ea-a5e4-4dc917d67c19 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:59.237963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0ed3-a187-42ea-a5e4-4dc917d67c19 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:59.250132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 581/1162] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:32:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:32:59.256481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:32:59.265441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84e63e-d4b1-44df-b0b2-8541c3a36e9a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:32:59.269801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687b6df-b66f-4190-8f6c-63beefbe02a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:32:59.270358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687b6df-b66f-4190-8f6c-63beefbe02a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:32:59.270646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687b6df-b66f-4190-8f6c-63beefbe02a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:32:59.270930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687b6df-b66f-4190-8f6c-63beefbe02a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:32:59.271695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687b6df-b66f-4190-8f6c-63beefbe02a0 admin admin] RBAC: Adding query filter params (role.id=58f38def815542948bd51acfd4644ea3, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=9ed63325027545d1bb46f1031a736089) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:32:59.272033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687b6df-b66f-4190-8f6c-63beefbe02a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:32:59.273861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687b6df-b66f-4190-8f6c-63beefbe02a0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:32:59.279334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 582/1163] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:32:59 2022] GET /identity/v3/role_assignments?user.id=9ed63325027545d1bb46f1031a736089&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=58f38def815542948bd51acfd4644ea3 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:01.432334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeab3f-b6cd-4613-829b-e4f8dfc2d3ee None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.432891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeab3f-b6cd-4613-829b-e4f8dfc2d3ee None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.432891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeab3f-b6cd-4613-829b-e4f8dfc2d3ee None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.434552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 582/1164] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:33:01.439643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf9b5-fa64-4a9f-a71f-001a4ffcde25 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.440097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf9b5-fa64-4a9f-a71f-001a4ffcde25 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.440250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf9b5-fa64-4a9f-a71f-001a4ffcde25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.463592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-344bf9b5-fa64-4a9f-a71f-001a4ffcde25 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:33:01.464759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-344bf9b5-fa64-4a9f-a71f-001a4ffcde25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:33:01.471724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 583/1165] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:33:01 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:33:01.495742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdeab3f-b6cd-4613-829b-e4f8dfc2d3ee None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.507854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdeab3f-b6cd-4613-829b-e4f8dfc2d3ee None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.511949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.512650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.512939 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.513223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.524517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:33:01.530767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:33:01.531823 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 583/1166] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:01.538126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bf9b5-fa64-4a9f-a71f-001a4ffcde25 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.546573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bf9b5-fa64-4a9f-a71f-001a4ffcde25 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.550715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.552246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.552552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.552830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.553540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:01.553839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.555420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.563664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 584/1167] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:01.569775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.579203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7857cd-7562-4019-97c9-c362b8ba1e78 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.584437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.585117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.585408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.585692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.596549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.598918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.617467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:33:01.618491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 584/1168] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:01.624058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.633801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c36448-2fcc-47c9-8a97-9b36de0b8575 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.638174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.638753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.639042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.639326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.640049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:01.640354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.641910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.654187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 585/1169] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:01.659945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.669598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b1e8e-c75a-4c60-a13d-1ecd34b555fe admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.673758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.674470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.674759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.675043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.688576 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.690491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.709312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:33:01.710346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 585/1170] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:01.716031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.725162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b1402-dbf6-45c3-8611-391a29eeaf0f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.729348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.729932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.730231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.730518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.731297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:01.731602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.733447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.763344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 586/1171] 10.222.0.23 () {56 vars in 1164 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:01.769065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.778349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0354-4660-49b5-be70-7fc067c9a937 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.782488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.783048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.783338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.783623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.791233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.792983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.802733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 586/1172] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:33:01.808497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.818193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacb388-1c4d-459a-8e68-7156b4d7f49d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.822422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.823128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.823417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.823703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.834951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.836777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.853163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:33:01.854193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 587/1173] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:01.860164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.869132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf10c6-6828-433c-8306-0c47d00a9913 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.873468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.874041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.874336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.874621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.875304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:01.875607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.877207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.890381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 587/1174] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:33:01.896850 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.907904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98f3f-db3b-44d9-8727-62d5958ae459 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.912745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.913457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.913749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.914035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.922471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.924447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.938732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:33:01.939739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 588/1175] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:01.946482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.955742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8707467-702d-4e9c-a21f-94cdb65d06ce admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.960213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4a469-cef7-437e-ae77-34361f83a307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.960793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4a469-cef7-437e-ae77-34361f83a307 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.961087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4a469-cef7-437e-ae77-34361f83a307 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.961374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4a469-cef7-437e-ae77-34361f83a307 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.962116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4a469-cef7-437e-ae77-34361f83a307 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:01.962423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4a469-cef7-437e-ae77-34361f83a307 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:01.964273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4a469-cef7-437e-ae77-34361f83a307 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:01.977191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 588/1176] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:01.983252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:01.993449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051d167-e3e4-43e3-a9d0-cb68e71faa78 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:01.997604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab5f8-091d-479e-a91d-4fad435f12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:01.998166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab5f8-091d-479e-a91d-4fad435f12c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:01.998451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab5f8-091d-479e-a91d-4fad435f12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:01.998733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab5f8-091d-479e-a91d-4fad435f12c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:01.999517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab5f8-091d-479e-a91d-4fad435f12c6 admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=9ed63325027545d1bb46f1031a736089) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:01.999820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab5f8-091d-479e-a91d-4fad435f12c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:02.001753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab5f8-091d-479e-a91d-4fad435f12c6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:02.007444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 589/1177] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:33:01 2022] GET /identity/v3/role_assignments?user.id=9ed63325027545d1bb46f1031a736089&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=3224d4d734484fac94d0c30f0093a334 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:33:04.078918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68955a8-26c1-4203-8de0-0e75f3d349a2 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.079542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68955a8-26c1-4203-8de0-0e75f3d349a2 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.079542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68955a8-26c1-4203-8de0-0e75f3d349a2 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.081184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 589/1178] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:33:04.086883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6472f1-6b95-4e5a-b55c-916bb038c6f8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.087287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6472f1-6b95-4e5a-b55c-916bb038c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.087453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6472f1-6b95-4e5a-b55c-916bb038c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.109770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-fe6472f1-6b95-4e5a-b55c-916bb038c6f8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:33:04.110924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-fe6472f1-6b95-4e5a-b55c-916bb038c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:33:04.118013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 590/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:33:04 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:33:04.140674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68955a8-26c1-4203-8de0-0e75f3d349a2 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.153004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68955a8-26c1-4203-8de0-0e75f3d349a2 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.157068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.157776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.158071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.158359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.170008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:33:04.176532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:33:04.177863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 590/1180] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:04.183653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6472f1-6b95-4e5a-b55c-916bb038c6f8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.193287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6472f1-6b95-4e5a-b55c-916bb038c6f8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.197539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.198126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.198418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.198704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.199418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:04.199722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.201328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.210272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 591/1181] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:04.215620 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.225741 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f844a-83ad-4fc1-8333-98e3e3f02acb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.229903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.230593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.230899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.231183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.242240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.244059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.261527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:33:04.262569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 591/1182] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:33:04.268064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.277789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4dc5d-ca73-46ce-be16-f8b04ba0fe77 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.282028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.282601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.282894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.283181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.283869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:04.284201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.285764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.297809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 592/1183] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:04.303272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.312450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30d2d7-c9ce-4cb3-895d-34a220b775c1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.316613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.317991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.318280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.318559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.330790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.333646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.350861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:33:04.351882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 592/1184] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:04.357500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.366935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a51df-f648-41d7-b0e5-6b6de23b36e7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.371188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.371766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.372115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.372402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.373192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:04.373496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.375324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.404790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 593/1185] 10.222.0.23 () {56 vars in 1164 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:04.410273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.419562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b4117-c7ec-46fc-a4ed-9a6874c44e3a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.424734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.425447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.425739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.426025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.438461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.440345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.458216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:33:04.459320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 593/1186] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:04.465084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.474827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19c6bc-30f2-46fe-b63e-d4c30b62e196 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.479115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.479700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.480022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.480340 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.481031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:04.481336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.482924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.495300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 594/1187] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:33:04.500785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.510686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20faf298-d03e-4260-b062-abba6535cabc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.514990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.515705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.516026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.516315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.524722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.526669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.540844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:33:04.541901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 594/1188] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:04.547578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.558080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b2ae3-91b8-46eb-97e0-ee048048e8f5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.562328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5306-2928-46fb-baec-37cc81195c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.562899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5306-2928-46fb-baec-37cc81195c31 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.563190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5306-2928-46fb-baec-37cc81195c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.563473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5306-2928-46fb-baec-37cc81195c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.564246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5306-2928-46fb-baec-37cc81195c31 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:04.564547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5306-2928-46fb-baec-37cc81195c31 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.566348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5306-2928-46fb-baec-37cc81195c31 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.578917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 595/1189] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:04.585382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:04.594379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0521c8-eb45-4a4d-b6ca-9ccc8cd6289e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:04.599230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ff415-87e4-4c03-b05a-5cb9e2efcb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:04.600049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ff415-87e4-4c03-b05a-5cb9e2efcb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:04.600338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ff415-87e4-4c03-b05a-5cb9e2efcb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:04.600622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ff415-87e4-4c03-b05a-5cb9e2efcb1a admin admin] PATH_INFO: `/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/9ed63325027545d1bb46f1031a736089/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:04.602368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ff415-87e4-4c03-b05a-5cb9e2efcb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a6fa2ee4d845909aeded129c76b0be, user_id=9ed63325027545d1bb46f1031a736089, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:04.604989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ff415-87e4-4c03-b05a-5cb9e2efcb1a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:04.617290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 595/1190] 10.222.0.23 () {58 vars in 1460 bytes} [Fri Apr 8 02:33:04 2022] PUT /identity/v3/projects/e1a6fa2ee4d845909aeded129c76b0be/users/9ed63325027545d1bb46f1031a736089/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:33:06.734599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6e2a6-c671-43f1-9f11-0bb28ac3f40c None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:06.735166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6e2a6-c671-43f1-9f11-0bb28ac3f40c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:06.735166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6e2a6-c671-43f1-9f11-0bb28ac3f40c None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:06.736882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 596/1191] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:33:06.742819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6301b-3abc-45b5-8fc6-48b3eaa7813c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:06.743257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6301b-3abc-45b5-8fc6-48b3eaa7813c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:06.743397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6301b-3abc-45b5-8fc6-48b3eaa7813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:06.765549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-65c6301b-3abc-45b5-8fc6-48b3eaa7813c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:33:06.766700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-65c6301b-3abc-45b5-8fc6-48b3eaa7813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:33:06.830846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 596/1192] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:33:06 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:33:06.854670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6e2a6-c671-43f1-9f11-0bb28ac3f40c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:06.867201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6e2a6-c671-43f1-9f11-0bb28ac3f40c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:06.871287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:06.872029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:06.872322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:06.872606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:06.884262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 08 02:33:06.890578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 08 02:33:06.891644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 597/1193] 10.222.0.23 () {56 vars in 1117 bytes} [Fri Apr 8 02:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:06.897548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6301b-3abc-45b5-8fc6-48b3eaa7813c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:06.906109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6301b-3abc-45b5-8fc6-48b3eaa7813c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:06.910319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:06.911102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:06.911392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:06.911678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:06.912438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:06.912746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:06.914335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:06.922578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 597/1194] 10.222.0.23 () {56 vars in 1120 bytes} [Fri Apr 8 02:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:06.928788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:06.938300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487a45-e71f-4b43-bb3c-035f7aa4243a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:06.943569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:06.944291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:06.944579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:06.944858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:06.955651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:06.957881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:06.974883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:33:06.975911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 598/1195] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:06.981426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:06.990933 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea5f5-03c1-49f6-a28b-8c6c92d61936 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:06.995081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:06.995652 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:06.995970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:06.996262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:06.996942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:06.997245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:06.998777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.011417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 598/1196] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:07.016637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.027728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c075c3-5d3a-442f-a66d-074b2026adfa admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.032083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.032799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.033092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.033380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.047363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.049405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.068064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 08 02:33:07.069117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 599/1197] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 08 02:33:07.074926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.084590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836cc14-d205-4e59-bb99-a1e1fad0f0f4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.088751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.089331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.089621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.089908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.090689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:07.090990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.092825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.121329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 599/1198] 10.222.0.23 () {56 vars in 1164 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:07.127125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.137019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2b929-ae35-459b-9130-fdf92148f14f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.141152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.141714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.142001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.142282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.150145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.151851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.160891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 600/1199] 10.222.0.23 () {58 vars in 1324 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:33:07.166528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.175485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012eff9-f640-4c78-bc3d-019ab9857fbd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.180541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.181239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.181528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.181814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.193679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.195458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.211756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 08 02:33:07.212812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 600/1200] 10.222.0.23 () {56 vars in 1129 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:07.219826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.228874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95843ee-b307-4d92-bb4a-226a4b707ca0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.233159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.233751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.234041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.234325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.235016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:07.235318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.236917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.249629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 601/1201] 10.222.0.23 () {56 vars in 1130 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:07.255205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.264416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151a6d-c3a1-4fd1-8654-ae4d42ad6f41 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.268546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.269236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.269525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.269872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.278092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.280056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.293834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING keystone.server.flask.application [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 08 02:33:07.294886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 601/1202] 10.222.0.23 () {56 vars in 1132 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:07.300874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.310726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06ac21-e91d-4e45-9597-ce011d3807cd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.314999 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d924f-cd29-4a20-b72b-9bdb04b9e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.315573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d924f-cd29-4a20-b72b-9bdb04b9e689 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.315859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d924f-cd29-4a20-b72b-9bdb04b9e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.316179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d924f-cd29-4a20-b72b-9bdb04b9e689 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.317467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d924f-cd29-4a20-b72b-9bdb04b9e689 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:07.317769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d924f-cd29-4a20-b72b-9bdb04b9e689 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.319564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d924f-cd29-4a20-b72b-9bdb04b9e689 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.331744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 602/1203] 10.222.0.23 () {56 vars in 1169 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:07.338505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:07.347609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c55f1-c4a2-4dee-b50a-33dba6153020 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:07.352314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c093f33-c1c4-48ba-8516-6f26c292febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:07.352877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093f33-c1c4-48ba-8516-6f26c292febf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:07.353172 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093f33-c1c4-48ba-8516-6f26c292febf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:07.353458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c093f33-c1c4-48ba-8516-6f26c292febf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:07.354236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093f33-c1c4-48ba-8516-6f26c292febf admin admin] RBAC: Adding query filter params (role.id=3224d4d734484fac94d0c30f0093a334, scope.project.id=e1a6fa2ee4d845909aeded129c76b0be, user.id=9ed63325027545d1bb46f1031a736089) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:07.354542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093f33-c1c4-48ba-8516-6f26c292febf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:07.356426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c093f33-c1c4-48ba-8516-6f26c292febf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:07.362012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 602/1204] 10.222.0.23 () {56 vars in 1395 bytes} [Fri Apr 8 02:33:07 2022] GET /identity/v3/role_assignments?user.id=9ed63325027545d1bb46f1031a736089&scope.project.id=e1a6fa2ee4d845909aeded129c76b0be&role.id=3224d4d734484fac94d0c30f0093a334 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:33:09.504690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cac35-9052-4a4c-9758-519fa1cdebbc None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:09.505156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cac35-9052-4a4c-9758-519fa1cdebbc None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:09.505437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05cac35-9052-4a4c-9758-519fa1cdebbc None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:09.507134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 603/1205] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:33:09.512486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9f710-6b05-47c9-a375-24a8a47df260 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:09.512914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9f710-6b05-47c9-a375-24a8a47df260 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:09.513065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9f710-6b05-47c9-a375-24a8a47df260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:09.535619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-aeb9f710-6b05-47c9-a375-24a8a47df260 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:33:09.536818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-aeb9f710-6b05-47c9-a375-24a8a47df260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:33:09.543668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 603/1206] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:33:09 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:33:09.565782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cac35-9052-4a4c-9758-519fa1cdebbc None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:09.578097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05cac35-9052-4a4c-9758-519fa1cdebbc None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:09.582137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:09.583420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:09.583709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:09.584019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:09.584645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:09.586215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:09.596488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 08 02:33:09.597514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 604/1207] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:33:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:09.603162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9f710-6b05-47c9-a375-24a8a47df260 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:09.611652 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9f710-6b05-47c9-a375-24a8a47df260 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:09.616472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d4e7-ff1d-42e0-9b4c-000a3dbcaef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:09.617050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d4e7-ff1d-42e0-9b4c-000a3dbcaef7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:09.617347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d4e7-ff1d-42e0-9b4c-000a3dbcaef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:09.617640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d4e7-ff1d-42e0-9b4c-000a3dbcaef7 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:09.618320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d4e7-ff1d-42e0-9b4c-000a3dbcaef7 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:09.618627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d4e7-ff1d-42e0-9b4c-000a3dbcaef7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:09.620221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23d4e7-ff1d-42e0-9b4c-000a3dbcaef7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:09.624938 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 604/1208] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Apr 8 02:33:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:09.630732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:09.639792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615ed5d-2466-4dcc-accb-67846c426769 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:09.644019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ed003-127d-4634-8b8b-64f032736a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:09.644586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed003-127d-4634-8b8b-64f032736a94 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:09.645683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed003-127d-4634-8b8b-64f032736a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:09.645683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ed003-127d-4634-8b8b-64f032736a94 admin admin] PATH_INFO: `/v3/services` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:09.646405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ed003-127d-4634-8b8b-64f032736a94 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:09.646714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ed003-127d-4634-8b8b-64f032736a94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:09.648290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ed003-127d-4634-8b8b-64f032736a94 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:09.652453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 605/1209] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Apr 8 02:33:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:11.753045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc93c-419e-479e-9165-9c034e90f799 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:11.753567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc93c-419e-479e-9165-9c034e90f799 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:11.753567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc93c-419e-479e-9165-9c034e90f799 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:11.755750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 605/1210] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:33:11.760889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a52a6-2435-43d3-be40-8ffa1818200d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:11.761324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a52a6-2435-43d3-be40-8ffa1818200d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:11.761465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a52a6-2435-43d3-be40-8ffa1818200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:11.783644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b50a52a6-2435-43d3-be40-8ffa1818200d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:33:11.784822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b50a52a6-2435-43d3-be40-8ffa1818200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:33:11.791833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 606/1211] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:33:11 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:33:11.815118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc93c-419e-479e-9165-9c034e90f799 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:11.827530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc93c-419e-479e-9165-9c034e90f799 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:11.831600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e70a35-9fbf-43f4-8102-015698dc5447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:11.832417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70a35-9fbf-43f4-8102-015698dc5447 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:11.832762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70a35-9fbf-43f4-8102-015698dc5447 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:11.833056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70a35-9fbf-43f4-8102-015698dc5447 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:11.833733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e70a35-9fbf-43f4-8102-015698dc5447 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:11.835318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e70a35-9fbf-43f4-8102-015698dc5447 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:11.847549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 606/1212] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Apr 8 02:33:11 2022] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:33:14.089652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6aff9-568f-4fe0-ae2b-ed9d7d9136c6 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:14.090185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6aff9-568f-4fe0-ae2b-ed9d7d9136c6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:14.090279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6aff9-568f-4fe0-ae2b-ed9d7d9136c6 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:14.091902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 607/1213] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:33:14.096941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554984-ce21-439c-bf61-f639823d9f78 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:14.097347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554984-ce21-439c-bf61-f639823d9f78 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:14.097520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b554984-ce21-439c-bf61-f639823d9f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:14.121142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3b554984-ce21-439c-bf61-f639823d9f78 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:33:14.122273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3b554984-ce21-439c-bf61-f639823d9f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:33:14.140412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 607/1214] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:33:14 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:33:14.164690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6aff9-568f-4fe0-ae2b-ed9d7d9136c6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:14.177486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6aff9-568f-4fe0-ae2b-ed9d7d9136c6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:14.181641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:14.182352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:14.182643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:14.182924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:14.183549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:14.185163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:14.195520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 08 02:33:14.196583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 608/1215] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:33:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:14.202450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554984-ce21-439c-bf61-f639823d9f78 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:14.211056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b554984-ce21-439c-bf61-f639823d9f78 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:14.215228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:14.215806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:14.216125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:14.216408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:14.217286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:14.217591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:14.219149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:14.224873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 608/1216] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Apr 8 02:33:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:14.230612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:14.240836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92965ac1-e7e1-4a50-b3fd-30afec0e7dd3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:14.245036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af300601-fb79-44d2-aa2c-43681a080513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:14.245597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af300601-fb79-44d2-aa2c-43681a080513 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:14.245886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af300601-fb79-44d2-aa2c-43681a080513 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:14.246172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af300601-fb79-44d2-aa2c-43681a080513 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:14.246905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af300601-fb79-44d2-aa2c-43681a080513 admin admin] RBAC: Adding query filter params (interface=public, service_id=c221869ee21042afaddad0e05fa583f1, region_id=RegionOne) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:14.247210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af300601-fb79-44d2-aa2c-43681a080513 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:14.248771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af300601-fb79-44d2-aa2c-43681a080513 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:14.253745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 609/1217] 10.222.0.23 () {56 vars in 1272 bytes} [Fri Apr 8 02:33:14 2022] GET /identity/v3/endpoints?service_id=c221869ee21042afaddad0e05fa583f1&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:14.259054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:14.268105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6289-187d-44df-9d70-9e19a45f0f1d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:14.272805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9298f2c-68d4-4925-acd1-b5cabba25c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:14.273359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9298f2c-68d4-4925-acd1-b5cabba25c53 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:14.273647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9298f2c-68d4-4925-acd1-b5cabba25c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:14.273928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9298f2c-68d4-4925-acd1-b5cabba25c53 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:14.274564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9298f2c-68d4-4925-acd1-b5cabba25c53 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:14.276112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9298f2c-68d4-4925-acd1-b5cabba25c53 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:14.282846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 609/1218] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:33:14 2022] GET /identity/v3/services => generated 2430 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:33:16.383781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35da2-c8ef-4789-918d-7cc89c17805f None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:16.384341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35da2-c8ef-4789-918d-7cc89c17805f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:16.384433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35da2-c8ef-4789-918d-7cc89c17805f None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:16.386046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 610/1219] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:33:16.391103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134a4d1-4173-4312-aec3-76e68bda492d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:16.391491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134a4d1-4173-4312-aec3-76e68bda492d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:16.391681 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134a4d1-4173-4312-aec3-76e68bda492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:16.413818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3134a4d1-4173-4312-aec3-76e68bda492d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:33:16.414957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3134a4d1-4173-4312-aec3-76e68bda492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:33:16.421922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 610/1220] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:33:16 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:33:16.445488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a35da2-c8ef-4789-918d-7cc89c17805f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:16.457166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a35da2-c8ef-4789-918d-7cc89c17805f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:16.461281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:16.461993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:16.462285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:16.462569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:16.463192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:16.464795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:16.475638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING keystone.server.flask.application [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 08 02:33:16.476712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 611/1221] 10.222.0.23 () {56 vars in 1138 bytes} [Fri Apr 8 02:33:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 08 02:33:16.482690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134a4d1-4173-4312-aec3-76e68bda492d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:16.492247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134a4d1-4173-4312-aec3-76e68bda492d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:16.496513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0380a1-3bfa-43a4-b6e6-540496cbd926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:16.497202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0380a1-3bfa-43a4-b6e6-540496cbd926 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:16.497500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0380a1-3bfa-43a4-b6e6-540496cbd926 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:16.497825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0380a1-3bfa-43a4-b6e6-540496cbd926 admin admin] PATH_INFO: `/v3/services` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:16.498512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0380a1-3bfa-43a4-b6e6-540496cbd926 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:33:16.498821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0380a1-3bfa-43a4-b6e6-540496cbd926 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:16.500433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0380a1-3bfa-43a4-b6e6-540496cbd926 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:16.505575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 611/1222] 10.222.0.23 () {56 vars in 1137 bytes} [Fri Apr 8 02:33:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:33:16.511012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:33:16.520803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4ec0-40be-4f0c-a9fb-2c2bea255e16 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:33:16.524997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89910-1da0-4897-ba63-723a504bed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:33:16.525563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89910-1da0-4897-ba63-723a504bed14 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:33:16.525856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89910-1da0-4897-ba63-723a504bed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:33:16.526141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89910-1da0-4897-ba63-723a504bed14 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:33:16.526831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89910-1da0-4897-ba63-723a504bed14 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:33:16.528436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89910-1da0-4897-ba63-723a504bed14 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:33:16.550046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 612/1223] 10.222.0.23 () {60 vars in 1165 bytes} [Fri Apr 8 02:33:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:34:38.308408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7573a-2b5b-4b38-b134-d6158541b2cf None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:38.309432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7573a-2b5b-4b38-b134-d6158541b2cf None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:38.309934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7573a-2b5b-4b38-b134-d6158541b2cf None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:38.316249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 612/1224] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:34:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:38.318401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8de0-0f1e-46fb-80e7-a3cca895e002 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:38.319403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8de0-0f1e-46fb-80e7-a3cca895e002 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:38.319752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8de0-0f1e-46fb-80e7-a3cca895e002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:38.424836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-cf1a8de0-0f1e-46fb-80e7-a3cca895e002 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:38.426566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cf1a8de0-0f1e-46fb-80e7-a3cca895e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:38.564749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 613/1225] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:38.588503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7573a-2b5b-4b38-b134-d6158541b2cf None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:38.590503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-61e7573a-2b5b-4b38-b134-d6158541b2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:38.744334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7573a-2b5b-4b38-b134-d6158541b2cf None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:38.853813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee870511-ba76-48d0-923e-beb95a25689b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:38.854428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870511-ba76-48d0-923e-beb95a25689b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:38.854724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870511-ba76-48d0-923e-beb95a25689b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:38.855016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870511-ba76-48d0-923e-beb95a25689b admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:38.855736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee870511-ba76-48d0-923e-beb95a25689b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:38.857683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee870511-ba76-48d0-923e-beb95a25689b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:38.874319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 613/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:34:38 2022] GET /identity/v3/projects => generated 2553 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:34:41.061357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac75f-5bab-4567-b848-5104d44fddcb None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:41.061950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac75f-5bab-4567-b848-5104d44fddcb None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:41.061950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ac75f-5bab-4567-b848-5104d44fddcb None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:41.063581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 614/1227] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:41.069338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ddda-54e6-4204-b18b-a12ee1a3487f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:41.069750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ddda-54e6-4204-b18b-a12ee1a3487f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:41.069905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ddda-54e6-4204-b18b-a12ee1a3487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:41.156747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6ec1ddda-54e6-4204-b18b-a12ee1a3487f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:41.157818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6ec1ddda-54e6-4204-b18b-a12ee1a3487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:41.265898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 614/1228] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:41.315788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a10c1-6eef-4f18-9354-56413c7abe01 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:41.316256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a10c1-6eef-4f18-9354-56413c7abe01 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:41.316619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a10c1-6eef-4f18-9354-56413c7abe01 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:41.318389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 615/1229] 10.222.0.23 () {54 vars in 964 bytes} [Fri Apr 8 02:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:41.326118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968f4a-9383-4ce4-b6ab-e20b9f8213a4 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:41.326421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968f4a-9383-4ce4-b6ab-e20b9f8213a4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:41.326706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968f4a-9383-4ce4-b6ab-e20b9f8213a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:41.432284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7f968f4a-9383-4ce4-b6ab-e20b9f8213a4 None None] MFA Rules not processed for user `865abd5c9d3b454ca1011e6e3111f580`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:41.433455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7f968f4a-9383-4ce4-b6ab-e20b9f8213a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:41.522509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 615/1230] 10.222.0.23 () {58 vars in 1061 bytes} [Fri Apr 8 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:41.531591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a10c1-6eef-4f18-9354-56413c7abe01 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:41.533091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-569a10c1-6eef-4f18-9354-56413c7abe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:41.654289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a10c1-6eef-4f18-9354-56413c7abe01 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:41.739847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace8ba1-3f1f-4d86-8edb-cb8220e18a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:41.740359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace8ba1-3f1f-4d86-8edb-cb8220e18a28 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:41.741723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace8ba1-3f1f-4d86-8edb-cb8220e18a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:41.742034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace8ba1-3f1f-4d86-8edb-cb8220e18a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:41.743775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bace8ba1-3f1f-4d86-8edb-cb8220e18a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:41.869693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace8ba1-3f1f-4d86-8edb-cb8220e18a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:41.871113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace8ba1-3f1f-4d86-8edb-cb8220e18a28 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:41.891329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 616/1231] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:44.294571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c68cf-da70-435b-9765-6253634d9d55 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:44.295122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c68cf-da70-435b-9765-6253634d9d55 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:44.295122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c68cf-da70-435b-9765-6253634d9d55 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:44.296832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 616/1232] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:44.301911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d4cd-9986-47c6-9577-417e444a2681 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:44.302347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d4cd-9986-47c6-9577-417e444a2681 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:44.302556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4d4cd-9986-47c6-9577-417e444a2681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:44.387062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-74e4d4cd-9986-47c6-9577-417e444a2681 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:44.388183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-74e4d4cd-9986-47c6-9577-417e444a2681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:44.493797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 617/1233] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:34:44.532292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c68cf-da70-435b-9765-6253634d9d55 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:44.533752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-325c68cf-da70-435b-9765-6253634d9d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:44.650092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c68cf-da70-435b-9765-6253634d9d55 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:44.733083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343bddb-bb77-46d3-a26b-abe0d929f191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:44.733662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343bddb-bb77-46d3-a26b-abe0d929f191 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:44.733953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343bddb-bb77-46d3-a26b-abe0d929f191 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:44.734238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343bddb-bb77-46d3-a26b-abe0d929f191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:44.735776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a343bddb-bb77-46d3-a26b-abe0d929f191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:44.860565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343bddb-bb77-46d3-a26b-abe0d929f191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:44.862028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343bddb-bb77-46d3-a26b-abe0d929f191 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:44.882767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 617/1234] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:34:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:47.326379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1262-eaaa-4506-b4e9-99dde6006277 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:47.326937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1262-eaaa-4506-b4e9-99dde6006277 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:47.326937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1262-eaaa-4506-b4e9-99dde6006277 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:47.328668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 618/1235] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:47.333947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f951d0-779a-44d6-838a-f457c0d55c80 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:47.335369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f951d0-779a-44d6-838a-f457c0d55c80 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:47.335369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f951d0-779a-44d6-838a-f457c0d55c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:47.423062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d5f951d0-779a-44d6-838a-f457c0d55c80 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:47.425144 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d5f951d0-779a-44d6-838a-f457c0d55c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:47.554377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 618/1236] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:47.589489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd1262-eaaa-4506-b4e9-99dde6006277 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:47.590946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-88cd1262-eaaa-4506-b4e9-99dde6006277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:47.731420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd1262-eaaa-4506-b4e9-99dde6006277 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:47.846536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70179636-664b-4f3e-8f8e-25f3060d7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:47.847244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179636-664b-4f3e-8f8e-25f3060d7408 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:47.847532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179636-664b-4f3e-8f8e-25f3060d7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:47.847814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70179636-664b-4f3e-8f8e-25f3060d7408 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:47.858853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179636-664b-4f3e-8f8e-25f3060d7408 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:47.861006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70179636-664b-4f3e-8f8e-25f3060d7408 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:47.862577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 619/1237] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:34:47 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:47.889061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148fd6-f877-4bb5-9938-93e7d616b2d4 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:47.889358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148fd6-f877-4bb5-9938-93e7d616b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:47.889647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148fd6-f877-4bb5-9938-93e7d616b2d4 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:47.891349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 619/1238] 10.222.0.23 () {54 vars in 964 bytes} [Fri Apr 8 02:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:47.898338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec86ec-dd4c-4d41-8acb-dc2ddcad1709 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:47.898630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec86ec-dd4c-4d41-8acb-dc2ddcad1709 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:47.898914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec86ec-dd4c-4d41-8acb-dc2ddcad1709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:47.995424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8bec86ec-dd4c-4d41-8acb-dc2ddcad1709 None None] MFA Rules not processed for user `865abd5c9d3b454ca1011e6e3111f580`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:47.996602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8bec86ec-dd4c-4d41-8acb-dc2ddcad1709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:48.083837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 620/1239] 10.222.0.23 () {58 vars in 1061 bytes} [Fri Apr 8 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:34:48.093308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148fd6-f877-4bb5-9938-93e7d616b2d4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:48.094797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3b148fd6-f877-4bb5-9938-93e7d616b2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:48.211520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148fd6-f877-4bb5-9938-93e7d616b2d4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:48.293682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506907e-4f4f-4865-9ead-355695374928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:48.294269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506907e-4f4f-4865-9ead-355695374928 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:48.294563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506907e-4f4f-4865-9ead-355695374928 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:48.294849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506907e-4f4f-4865-9ead-355695374928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:48.296430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6506907e-4f4f-4865-9ead-355695374928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:48.417957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506907e-4f4f-4865-9ead-355695374928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:48.419310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506907e-4f4f-4865-9ead-355695374928 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:48.438802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 620/1240] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:34:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:51.514368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5caf8-8dae-46a8-9b55-acb32c524995 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:51.514804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5caf8-8dae-46a8-9b55-acb32c524995 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:51.514941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5caf8-8dae-46a8-9b55-acb32c524995 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:51.516684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 621/1241] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:51.522107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:51.522516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:51.522685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:51.608000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:51.609183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:51.714110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 621/1242] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:51.748008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5caf8-8dae-46a8-9b55-acb32c524995 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:51.749527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-aec5caf8-8dae-46a8-9b55-acb32c524995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:51.887951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5caf8-8dae-46a8-9b55-acb32c524995 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:51.990080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b23e-f8aa-4cbd-bee2-99375a0a0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:51.990965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b23e-f8aa-4cbd-bee2-99375a0a0039 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:51.991261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b23e-f8aa-4cbd-bee2-99375a0a0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:51.991551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b23e-f8aa-4cbd-bee2-99375a0a0039 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:52.002196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b23e-f8aa-4cbd-bee2-99375a0a0039 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:52.004242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b23e-f8aa-4cbd-bee2-99375a0a0039 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:52.005804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 622/1243] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:34:51 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:34:52.018199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:52.019349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:52.125082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8bf78-81b0-4f95-b631-37bea5e948d0 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:52.208011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9739c9d-9a8c-4764-8fb7-ad0e0955e928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:52.208602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9739c9d-9a8c-4764-8fb7-ad0e0955e928 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:52.208971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9739c9d-9a8c-4764-8fb7-ad0e0955e928 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:52.209940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9739c9d-9a8c-4764-8fb7-ad0e0955e928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:52.211506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c9739c9d-9a8c-4764-8fb7-ad0e0955e928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:52.335718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9739c9d-9a8c-4764-8fb7-ad0e0955e928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:52.337189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9739c9d-9a8c-4764-8fb7-ad0e0955e928 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:52.356322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 622/1244] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:55.167633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e851a-49a9-4456-8cc4-7e71a9e244f3 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:55.168194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e851a-49a9-4456-8cc4-7e71a9e244f3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:55.168317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e851a-49a9-4456-8cc4-7e71a9e244f3 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:55.170975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 623/1245] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:55.179404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f3a2-0860-473e-a75d-899828d06d29 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:55.179859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f3a2-0860-473e-a75d-899828d06d29 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:55.180016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0f3a2-0860-473e-a75d-899828d06d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:55.276981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-33f0f3a2-0860-473e-a75d-899828d06d29 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:55.278204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-33f0f3a2-0860-473e-a75d-899828d06d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:55.388545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 623/1246] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:34:55.425058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e851a-49a9-4456-8cc4-7e71a9e244f3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:55.426600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ed2e851a-49a9-4456-8cc4-7e71a9e244f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:55.560395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e851a-49a9-4456-8cc4-7e71a9e244f3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:55.643405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97781c1-22a0-4953-86f6-9949a49850c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:55.644007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97781c1-22a0-4953-86f6-9949a49850c6 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:55.644296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97781c1-22a0-4953-86f6-9949a49850c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:55.644575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97781c1-22a0-4953-86f6-9949a49850c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:55.646118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e97781c1-22a0-4953-86f6-9949a49850c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:55.768799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97781c1-22a0-4953-86f6-9949a49850c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:55.770150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97781c1-22a0-4953-86f6-9949a49850c6 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:55.790424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 624/1247] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:34:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:34:57.983842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4fcd3-65c6-4eff-a08a-49535d8037fa None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:57.984377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4fcd3-65c6-4eff-a08a-49535d8037fa None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:57.984466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4fcd3-65c6-4eff-a08a-49535d8037fa None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:57.986203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 624/1248] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:34:57.992302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca01e-718c-4bf8-b99d-85505247ec5d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:57.992692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca01e-718c-4bf8-b99d-85505247ec5d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:57.993010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fca01e-718c-4bf8-b99d-85505247ec5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:58.081455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-09fca01e-718c-4bf8-b99d-85505247ec5d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:34:58.082527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-09fca01e-718c-4bf8-b99d-85505247ec5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:58.199409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 625/1249] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:34:58.238291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4fcd3-65c6-4eff-a08a-49535d8037fa None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:34:58.239826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-54a4fcd3-65c6-4eff-a08a-49535d8037fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:58.365736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4fcd3-65c6-4eff-a08a-49535d8037fa None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:34:58.456928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631708a-a787-48d7-8492-adbe4dccb9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:34:58.457595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631708a-a787-48d7-8492-adbe4dccb9db service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:34:58.457809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631708a-a787-48d7-8492-adbe4dccb9db service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:34:58.458238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631708a-a787-48d7-8492-adbe4dccb9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:34:58.461012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e631708a-a787-48d7-8492-adbe4dccb9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:34:58.587182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631708a-a787-48d7-8492-adbe4dccb9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:34:58.588668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631708a-a787-48d7-8492-adbe4dccb9db service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:34:58.607648 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 625/1250] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:34:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:00.797869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abce7-8afd-4daf-933b-d206ae46e5b5 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:00.798369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abce7-8afd-4daf-933b-d206ae46e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:00.798369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abce7-8afd-4daf-933b-d206ae46e5b5 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:00.800036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 626/1251] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:00.806152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:00.806619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:00.806735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:00.897152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:00.898321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:01.003253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 626/1252] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:01.035004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1abce7-8afd-4daf-933b-d206ae46e5b5 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:01.036502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cc1abce7-8afd-4daf-933b-d206ae46e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:01.180280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1abce7-8afd-4daf-933b-d206ae46e5b5 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:01.282697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3a164-d5e2-4ae2-9ec5-cd30337ccfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:01.283480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3a164-d5e2-4ae2-9ec5-cd30337ccfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:01.283771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3a164-d5e2-4ae2-9ec5-cd30337ccfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:01.284084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3a164-d5e2-4ae2-9ec5-cd30337ccfd0 admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:01.295009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3a164-d5e2-4ae2-9ec5-cd30337ccfd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:01.297091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3a164-d5e2-4ae2-9ec5-cd30337ccfd0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:01.298644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 627/1253] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:35:01 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:35:01.311704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:01.312903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:01.417000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567581cf-2def-4c0d-8093-8cbac8746a0a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:01.508092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f6c74-3ec2-45a1-9ef3-ba1476144e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:01.508685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f6c74-3ec2-45a1-9ef3-ba1476144e58 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:01.508983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f6c74-3ec2-45a1-9ef3-ba1476144e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:01.509280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f6c74-3ec2-45a1-9ef3-ba1476144e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:01.510857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f25f6c74-3ec2-45a1-9ef3-ba1476144e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:01.637923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f6c74-3ec2-45a1-9ef3-ba1476144e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:01.639365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f6c74-3ec2-45a1-9ef3-ba1476144e58 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:01.658940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 627/1254] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:04.025615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b803a4-873d-4979-8cbf-375705729716 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:04.026175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b803a4-873d-4979-8cbf-375705729716 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:04.026175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b803a4-873d-4979-8cbf-375705729716 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:04.027876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 628/1255] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:04.033093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768baae-330e-47ce-8a5c-2d960ffddbf8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:04.033475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768baae-330e-47ce-8a5c-2d960ffddbf8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:04.033665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768baae-330e-47ce-8a5c-2d960ffddbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:04.120059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a768baae-330e-47ce-8a5c-2d960ffddbf8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:04.121225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a768baae-330e-47ce-8a5c-2d960ffddbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:04.230827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 628/1256] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:04.267246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b803a4-873d-4979-8cbf-375705729716 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:04.268804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e2b803a4-873d-4979-8cbf-375705729716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:04.388003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b803a4-873d-4979-8cbf-375705729716 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:04.475541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae54e3-9bdb-499a-9d78-2902f7d97347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:04.476157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae54e3-9bdb-499a-9d78-2902f7d97347 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:04.476453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae54e3-9bdb-499a-9d78-2902f7d97347 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:04.476739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae54e3-9bdb-499a-9d78-2902f7d97347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:04.478313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-efae54e3-9bdb-499a-9d78-2902f7d97347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:04.602197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae54e3-9bdb-499a-9d78-2902f7d97347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:04.603618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae54e3-9bdb-499a-9d78-2902f7d97347 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:04.622938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 629/1257] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:06.781419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b9122-9fa5-4417-86c3-49a12c3147b9 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:06.781924 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b9122-9fa5-4417-86c3-49a12c3147b9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:06.781924 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b9122-9fa5-4417-86c3-49a12c3147b9 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:06.783597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 629/1258] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:06.789019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184bc7a-d303-432e-bb8b-7121cfac4fd5 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:06.789435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184bc7a-d303-432e-bb8b-7121cfac4fd5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:06.789596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184bc7a-d303-432e-bb8b-7121cfac4fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:06.874814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6184bc7a-d303-432e-bb8b-7121cfac4fd5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:06.876023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6184bc7a-d303-432e-bb8b-7121cfac4fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:06.980442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 630/1259] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:07.021262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b9122-9fa5-4417-86c3-49a12c3147b9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:07.022730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ea2b9122-9fa5-4417-86c3-49a12c3147b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:07.141241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b9122-9fa5-4417-86c3-49a12c3147b9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:07.227082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a9502-c7db-401f-a347-657348478e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:07.227670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a9502-c7db-401f-a347-657348478e28 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:07.227986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a9502-c7db-401f-a347-657348478e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:07.228277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a9502-c7db-401f-a347-657348478e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:07.229839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-865a9502-c7db-401f-a347-657348478e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:07.351405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a9502-c7db-401f-a347-657348478e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:07.352886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a9502-c7db-401f-a347-657348478e28 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:07.371653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 630/1260] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:09.898263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c027d0-0d7b-4419-a1aa-235ed444cf68 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:09.898819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c027d0-0d7b-4419-a1aa-235ed444cf68 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:09.898819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c027d0-0d7b-4419-a1aa-235ed444cf68 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:09.900531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 631/1261] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:09.906345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014332f-5fb8-40da-8e0b-fb23028700bd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:09.906960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014332f-5fb8-40da-8e0b-fb23028700bd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:09.907420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014332f-5fb8-40da-8e0b-fb23028700bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:10.001874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8014332f-5fb8-40da-8e0b-fb23028700bd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:10.003028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8014332f-5fb8-40da-8e0b-fb23028700bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:10.114446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 631/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:10.152004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c027d0-0d7b-4419-a1aa-235ed444cf68 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:10.154041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b1c027d0-0d7b-4419-a1aa-235ed444cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:10.261387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c027d0-0d7b-4419-a1aa-235ed444cf68 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:10.264724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86edab-b674-4647-8ddc-931214f8dcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:10.265300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86edab-b674-4647-8ddc-931214f8dcbf service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:10.265587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86edab-b674-4647-8ddc-931214f8dcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:10.265869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86edab-b674-4647-8ddc-931214f8dcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:10.274923 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86edab-b674-4647-8ddc-931214f8dcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:10.276364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86edab-b674-4647-8ddc-931214f8dcbf service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:10.285089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 632/1263] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:14.752949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351942-96a6-4e1a-abe7-dcad374ffe8e None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:14.753471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351942-96a6-4e1a-abe7-dcad374ffe8e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:14.753471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4351942-96a6-4e1a-abe7-dcad374ffe8e None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:14.755628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 632/1264] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:14.761161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73fe79-098b-4f93-b2ca-2661c731d933 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:14.761583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73fe79-098b-4f93-b2ca-2661c731d933 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:14.761742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73fe79-098b-4f93-b2ca-2661c731d933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:14.787851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2a73fe79-098b-4f93-b2ca-2661c731d933 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:14.789094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2a73fe79-098b-4f93-b2ca-2661c731d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:14.796753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 633/1265] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:14.837399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351942-96a6-4e1a-abe7-dcad374ffe8e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:14.839186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c4351942-96a6-4e1a-abe7-dcad374ffe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:14.852523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4351942-96a6-4e1a-abe7-dcad374ffe8e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:14.855902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780a511-5045-4c39-9cd7-815350455e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:14.856514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a511-5045-4c39-9cd7-815350455e85 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:14.856810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a511-5045-4c39-9cd7-815350455e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:14.857098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780a511-5045-4c39-9cd7-815350455e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:14.866583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780a511-5045-4c39-9cd7-815350455e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:14.868056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780a511-5045-4c39-9cd7-815350455e85 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:14.877162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 633/1266] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:17.916188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17cf34-62d4-44c8-ac5d-472f987c0fad None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:17.916754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17cf34-62d4-44c8-ac5d-472f987c0fad None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:17.916754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17cf34-62d4-44c8-ac5d-472f987c0fad None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:17.918437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 634/1267] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:17.923661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97e2b-4db3-4d8b-a001-43622befd9c3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:17.924062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97e2b-4db3-4d8b-a001-43622befd9c3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:17.924305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97e2b-4db3-4d8b-a001-43622befd9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:17.947086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b3b97e2b-4db3-4d8b-a001-43622befd9c3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:17.948281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b3b97e2b-4db3-4d8b-a001-43622befd9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:17.955740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 634/1268] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:17.994041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17cf34-62d4-44c8-ac5d-472f987c0fad None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:18.004527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17cf34-62d4-44c8-ac5d-472f987c0fad None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:18.008527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697df4b7-ce38-446b-a1b0-693e2cf035d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:18.009089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697df4b7-ce38-446b-a1b0-693e2cf035d2 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:18.009376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697df4b7-ce38-446b-a1b0-693e2cf035d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:18.009658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697df4b7-ce38-446b-a1b0-693e2cf035d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:18.018342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697df4b7-ce38-446b-a1b0-693e2cf035d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:18.019756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697df4b7-ce38-446b-a1b0-693e2cf035d2 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:18.028748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 635/1269] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:35:23.078478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9838f6-b18a-4d12-bbd6-ed42b0beb939 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:23.078958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9838f6-b18a-4d12-bbd6-ed42b0beb939 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:23.079050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9838f6-b18a-4d12-bbd6-ed42b0beb939 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:23.080948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 635/1270] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:35:23.087156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39a8a-a7d7-4c2b-8b2a-4ea1d3227d44 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:23.087575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39a8a-a7d7-4c2b-8b2a-4ea1d3227d44 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:23.087720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39a8a-a7d7-4c2b-8b2a-4ea1d3227d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:23.109717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-09a39a8a-a7d7-4c2b-8b2a-4ea1d3227d44 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:23.110890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-09a39a8a-a7d7-4c2b-8b2a-4ea1d3227d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:23.119508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 636/1271] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:23.159243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9838f6-b18a-4d12-bbd6-ed42b0beb939 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:23.170870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9838f6-b18a-4d12-bbd6-ed42b0beb939 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:23.174293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8099e-d9c6-4076-bc52-903f69dcd003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:23.174871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8099e-d9c6-4076-bc52-903f69dcd003 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:23.175162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8099e-d9c6-4076-bc52-903f69dcd003 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:23.175445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8099e-d9c6-4076-bc52-903f69dcd003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:23.185611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8099e-d9c6-4076-bc52-903f69dcd003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:23.188174 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8099e-d9c6-4076-bc52-903f69dcd003 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:23.198591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 636/1272] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:27.746308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85a77-d6df-43a7-8578-531db747aac9 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:27.747138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85a77-d6df-43a7-8578-531db747aac9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:27.747607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b85a77-d6df-43a7-8578-531db747aac9 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:27.749759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 637/1273] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:27.756456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8bec-e50f-40c1-b2d3-7ddc3c9b8557 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:27.757211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8bec-e50f-40c1-b2d3-7ddc3c9b8557 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:27.757695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8bec-e50f-40c1-b2d3-7ddc3c9b8557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:27.871308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-690a8bec-e50f-40c1-b2d3-7ddc3c9b8557 None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:27.873080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-690a8bec-e50f-40c1-b2d3-7ddc3c9b8557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:27.973554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 637/1274] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:35:27 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:28.385636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab06b-3794-4655-8402-fa70199c7fcd None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:28.385963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab06b-3794-4655-8402-fa70199c7fcd None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:28.386451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab06b-3794-4655-8402-fa70199c7fcd None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:28.388573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 638/1275] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:28.393857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a936a3-1c5d-464e-9b6f-477f8d17846c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:28.394092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a936a3-1c5d-464e-9b6f-477f8d17846c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:28.394377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a936a3-1c5d-464e-9b6f-477f8d17846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:28.419151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d8a936a3-1c5d-464e-9b6f-477f8d17846c None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:28.421097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d8a936a3-1c5d-464e-9b6f-477f8d17846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:28.433046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 638/1276] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:35:28 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:32.450425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dda71-0049-4fad-bebb-5d1f7c7639f4 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:32.450918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dda71-0049-4fad-bebb-5d1f7c7639f4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:32.450918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dda71-0049-4fad-bebb-5d1f7c7639f4 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:32.452910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 639/1277] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:32.458440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacfb7e-dea6-44b7-b0ae-3b3e88a1b4c5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:32.459149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacfb7e-dea6-44b7-b0ae-3b3e88a1b4c5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:32.459149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacfb7e-dea6-44b7-b0ae-3b3e88a1b4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:32.486068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-acacfb7e-dea6-44b7-b0ae-3b3e88a1b4c5 None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:32.487248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-acacfb7e-dea6-44b7-b0ae-3b3e88a1b4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:32.495864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 639/1278] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:35:32 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:33.897564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1164d-6ab4-4dc0-b291-a60f43e231c9 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:33.898089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1164d-6ab4-4dc0-b291-a60f43e231c9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:33.898177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1164d-6ab4-4dc0-b291-a60f43e231c9 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:33.899775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 640/1279] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:33.904702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacbb1-0e07-47b9-9fe5-073dba4e97b4 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:33.905157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacbb1-0e07-47b9-9fe5-073dba4e97b4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:33.905280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacbb1-0e07-47b9-9fe5-073dba4e97b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:33.930939 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c8cacbb1-0e07-47b9-9fe5-073dba4e97b4 None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:33.932551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c8cacbb1-0e07-47b9-9fe5-073dba4e97b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:33.940601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 640/1280] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:37.716597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287420f1-36e3-4b8b-9437-f9c449c43aec None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:37.717144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287420f1-36e3-4b8b-9437-f9c449c43aec None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:37.717144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287420f1-36e3-4b8b-9437-f9c449c43aec None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:37.718810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 641/1281] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:37.724253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88834e-dfb6-420c-8995-6b3b8ccfbdbd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:37.724680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88834e-dfb6-420c-8995-6b3b8ccfbdbd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:37.724832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88834e-dfb6-420c-8995-6b3b8ccfbdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:37.747548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6d88834e-dfb6-420c-8995-6b3b8ccfbdbd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:37.748725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6d88834e-dfb6-420c-8995-6b3b8ccfbdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:37.756826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 641/1282] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:37.804844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae25d53-2b0d-4f84-ae3c-b418c28ec221 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:37.805141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae25d53-2b0d-4f84-ae3c-b418c28ec221 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:37.805428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae25d53-2b0d-4f84-ae3c-b418c28ec221 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:37.807112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 642/1283] 10.222.0.23 () {54 vars in 959 bytes} [Fri Apr 8 02:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:37.812492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39302f-c963-425a-acd3-25fc0a863bdb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:37.812796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39302f-c963-425a-acd3-25fc0a863bdb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:37.813092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39302f-c963-425a-acd3-25fc0a863bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:37.882840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5c39302f-c963-425a-acd3-25fc0a863bdb None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:37.884028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5c39302f-c963-425a-acd3-25fc0a863bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:37.970608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 642/1284] 10.222.0.23 () {58 vars in 1056 bytes} [Fri Apr 8 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:37.978928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae25d53-2b0d-4f84-ae3c-b418c28ec221 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:37.993228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae25d53-2b0d-4f84-ae3c-b418c28ec221 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:37.998688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bef9e-f645-48eb-aedd-4b926268590b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:37.999262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bef9e-f645-48eb-aedd-4b926268590b service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:37.999549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bef9e-f645-48eb-aedd-4b926268590b service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:37.999830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bef9e-f645-48eb-aedd-4b926268590b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:38.008677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bef9e-f645-48eb-aedd-4b926268590b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:38.010201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295bef9e-f645-48eb-aedd-4b926268590b service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:38.019752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 643/1285] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:35:40.447446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538970b-22fc-46d6-9f10-b819b1f0151d None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:40.447968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538970b-22fc-46d6-9f10-b819b1f0151d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:40.447968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538970b-22fc-46d6-9f10-b819b1f0151d None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:40.449668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 643/1286] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:40.454918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7a1b-22b5-4a8a-9c33-e7ab66998989 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:40.455368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7a1b-22b5-4a8a-9c33-e7ab66998989 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:40.455636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c7a1b-22b5-4a8a-9c33-e7ab66998989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:40.478428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-934c7a1b-22b5-4a8a-9c33-e7ab66998989 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:40.479584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-934c7a1b-22b5-4a8a-9c33-e7ab66998989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:40.487272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 644/1287] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:40.534046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538970b-22fc-46d6-9f10-b819b1f0151d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:40.547719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538970b-22fc-46d6-9f10-b819b1f0151d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:40.553481 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3ad71-599f-4b54-93ce-d24b3a583b6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:40.554306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3ad71-599f-4b54-93ce-d24b3a583b6b service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:40.554603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3ad71-599f-4b54-93ce-d24b3a583b6b service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:40.554889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3ad71-599f-4b54-93ce-d24b3a583b6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:40.562677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3ad71-599f-4b54-93ce-d24b3a583b6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:40.564315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3ad71-599f-4b54-93ce-d24b3a583b6b service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:40.573813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 644/1288] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:43.084647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026cd46-c8bb-4b07-b714-38ad0196a28b None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:43.085229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026cd46-c8bb-4b07-b714-38ad0196a28b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:43.085324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026cd46-c8bb-4b07-b714-38ad0196a28b None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:43.086937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 645/1289] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:43.092121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164de5e3-75fe-484c-a65e-7e0f6c526a78 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:43.092516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164de5e3-75fe-484c-a65e-7e0f6c526a78 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:43.092702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164de5e3-75fe-484c-a65e-7e0f6c526a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:43.117105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-164de5e3-75fe-484c-a65e-7e0f6c526a78 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:43.118271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-164de5e3-75fe-484c-a65e-7e0f6c526a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:43.125433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 645/1290] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:43.169170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284823be-dd38-4c29-ae2d-ec523231315f None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:43.169494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284823be-dd38-4c29-ae2d-ec523231315f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:43.169784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284823be-dd38-4c29-ae2d-ec523231315f None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:43.171428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 646/1291] 10.222.0.23 () {54 vars in 959 bytes} [Fri Apr 8 02:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:43.176915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d967e3-2848-4d0b-97bc-b1d843fd3e8b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:43.177212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d967e3-2848-4d0b-97bc-b1d843fd3e8b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:43.177503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d967e3-2848-4d0b-97bc-b1d843fd3e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:43.200217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d1d967e3-2848-4d0b-97bc-b1d843fd3e8b None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:43.201353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d1d967e3-2848-4d0b-97bc-b1d843fd3e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:43.210554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 646/1292] 10.222.0.23 () {58 vars in 1056 bytes} [Fri Apr 8 02:35:43 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:43.218255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284823be-dd38-4c29-ae2d-ec523231315f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:43.231846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284823be-dd38-4c29-ae2d-ec523231315f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:43.236846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a390868-9c42-4c47-a9db-8ceaa58584a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:43.237413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390868-9c42-4c47-a9db-8ceaa58584a2 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:43.237698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390868-9c42-4c47-a9db-8ceaa58584a2 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:43.237976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390868-9c42-4c47-a9db-8ceaa58584a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:43.246054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a390868-9c42-4c47-a9db-8ceaa58584a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:43.247611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a390868-9c42-4c47-a9db-8ceaa58584a2 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:43.257351 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 647/1293] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:35:45.460343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea219-d4e4-4315-8782-fb407d375bda None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:45.460931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea219-d4e4-4315-8782-fb407d375bda None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:45.460931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea219-d4e4-4315-8782-fb407d375bda None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:45.462581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 647/1294] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:45.467734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ddf5c-6459-410e-b3a8-78770dd3abb6 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:45.468223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ddf5c-6459-410e-b3a8-78770dd3abb6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:45.468502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ddf5c-6459-410e-b3a8-78770dd3abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:45.490531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-901ddf5c-6459-410e-b3a8-78770dd3abb6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:45.491700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-901ddf5c-6459-410e-b3a8-78770dd3abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:45.498778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 648/1295] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:45.542662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea219-d4e4-4315-8782-fb407d375bda None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:45.556324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea219-d4e4-4315-8782-fb407d375bda None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:45.561345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da44be-1e42-48e0-b885-6dc495a673a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:45.561936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da44be-1e42-48e0-b885-6dc495a673a1 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:45.562223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da44be-1e42-48e0-b885-6dc495a673a1 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:45.562504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da44be-1e42-48e0-b885-6dc495a673a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:45.570859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da44be-1e42-48e0-b885-6dc495a673a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:45.572436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da44be-1e42-48e0-b885-6dc495a673a1 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:45.581177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 648/1296] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:47.745645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b32af-a5b0-464b-a0e4-ddb3262547a9 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:47.746208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b32af-a5b0-464b-a0e4-ddb3262547a9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:47.746208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b32af-a5b0-464b-a0e4-ddb3262547a9 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:47.747884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 649/1297] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:47.753192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d569f2-3969-4558-9027-8b4452371734 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:47.753597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d569f2-3969-4558-9027-8b4452371734 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:47.753697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d569f2-3969-4558-9027-8b4452371734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:47.777288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-60d569f2-3969-4558-9027-8b4452371734 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:47.778439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-60d569f2-3969-4558-9027-8b4452371734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:47.785869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 649/1298] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:47.828965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b32af-a5b0-464b-a0e4-ddb3262547a9 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:47.843155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b32af-a5b0-464b-a0e4-ddb3262547a9 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:47.848365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414a01f-c356-4bdc-8426-27401f1334d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:47.848960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a01f-c356-4bdc-8426-27401f1334d4 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:47.849253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a01f-c356-4bdc-8426-27401f1334d4 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:47.849539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414a01f-c356-4bdc-8426-27401f1334d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:47.857413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414a01f-c356-4bdc-8426-27401f1334d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:47.859101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414a01f-c356-4bdc-8426-27401f1334d4 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:47.868082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 650/1299] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:50.059608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5c0a5-31a1-4b46-ab65-1db56c01d593 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:50.060219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5c0a5-31a1-4b46-ab65-1db56c01d593 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:50.060219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5c0a5-31a1-4b46-ab65-1db56c01d593 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:50.061902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 650/1300] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:50.067540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29daeb1-1f5a-4154-9940-02a99188e10c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:50.068068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29daeb1-1f5a-4154-9940-02a99188e10c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:50.068190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29daeb1-1f5a-4154-9940-02a99188e10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:50.090600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a29daeb1-1f5a-4154-9940-02a99188e10c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:50.091755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a29daeb1-1f5a-4154-9940-02a99188e10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:50.100180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 651/1301] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:50.143702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5c0a5-31a1-4b46-ab65-1db56c01d593 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:50.158045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5c0a5-31a1-4b46-ab65-1db56c01d593 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:50.163624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250880b7-976b-4f89-9465-3a06d06179c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:50.164240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250880b7-976b-4f89-9465-3a06d06179c7 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:50.164563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250880b7-976b-4f89-9465-3a06d06179c7 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:50.164851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250880b7-976b-4f89-9465-3a06d06179c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:50.172876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250880b7-976b-4f89-9465-3a06d06179c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:50.174448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250880b7-976b-4f89-9465-3a06d06179c7 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:50.184290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 651/1302] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:52.348252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b4032-2b50-4825-96ec-ba3355d98eb2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:52.348780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b4032-2b50-4825-96ec-ba3355d98eb2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:52.348893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b4032-2b50-4825-96ec-ba3355d98eb2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:52.350495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 652/1303] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:52.355763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3776-ac1c-46ba-9d95-c6a5b48438b8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:52.356203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3776-ac1c-46ba-9d95-c6a5b48438b8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:52.356356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3776-ac1c-46ba-9d95-c6a5b48438b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:52.378869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-ce0c3776-ac1c-46ba-9d95-c6a5b48438b8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:52.380222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ce0c3776-ac1c-46ba-9d95-c6a5b48438b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:52.387342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 652/1304] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:35:52.429234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b4032-2b50-4825-96ec-ba3355d98eb2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:52.442855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b4032-2b50-4825-96ec-ba3355d98eb2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:52.447908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba834369-0c1c-4355-9dac-38eb0d770835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:52.448516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834369-0c1c-4355-9dac-38eb0d770835 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:52.448810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834369-0c1c-4355-9dac-38eb0d770835 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:52.449099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834369-0c1c-4355-9dac-38eb0d770835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:52.457558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba834369-0c1c-4355-9dac-38eb0d770835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:52.459118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba834369-0c1c-4355-9dac-38eb0d770835 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:52.467869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 653/1305] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:54.574733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7483f3-1f0e-410e-828e-3cfdf2b7130b None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:54.575260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7483f3-1f0e-410e-828e-3cfdf2b7130b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:54.575368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7483f3-1f0e-410e-828e-3cfdf2b7130b None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:54.577003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 653/1306] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:54.582456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d410c-b4d1-4351-8dda-bdd96940dfd5 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:54.582971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d410c-b4d1-4351-8dda-bdd96940dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:54.583074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d410c-b4d1-4351-8dda-bdd96940dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:54.605524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bc8d410c-b4d1-4351-8dda-bdd96940dfd5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:54.606659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bc8d410c-b4d1-4351-8dda-bdd96940dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:54.614435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 654/1307] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:54.659472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7483f3-1f0e-410e-828e-3cfdf2b7130b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:54.673474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7483f3-1f0e-410e-828e-3cfdf2b7130b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:54.679477 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ded7a-ee48-4077-a8f2-56641811b65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:54.680077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ded7a-ee48-4077-a8f2-56641811b65a service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:54.680366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ded7a-ee48-4077-a8f2-56641811b65a service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:54.680650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ded7a-ee48-4077-a8f2-56641811b65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:54.688497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ded7a-ee48-4077-a8f2-56641811b65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:54.690069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ded7a-ee48-4077-a8f2-56641811b65a service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:54.699066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 654/1308] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:56.833533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dbeca-b127-48d4-bec1-62f0d4369933 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:56.834049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dbeca-b127-48d4-bec1-62f0d4369933 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:56.834158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dbeca-b127-48d4-bec1-62f0d4369933 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:56.835763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 655/1309] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:56.840950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97628ca-d675-4fa8-92da-b6ccf89e0c20 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:56.841385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97628ca-d675-4fa8-92da-b6ccf89e0c20 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:56.841531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97628ca-d675-4fa8-92da-b6ccf89e0c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:56.865056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d97628ca-d675-4fa8-92da-b6ccf89e0c20 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:56.866206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d97628ca-d675-4fa8-92da-b6ccf89e0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:56.873329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 655/1310] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:35:56.917449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dbeca-b127-48d4-bec1-62f0d4369933 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:56.931711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dbeca-b127-48d4-bec1-62f0d4369933 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:56.936621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5951a11-c933-48ca-a23c-2fc590f0d473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:56.937180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951a11-c933-48ca-a23c-2fc590f0d473 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:56.937467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951a11-c933-48ca-a23c-2fc590f0d473 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:56.937747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951a11-c933-48ca-a23c-2fc590f0d473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:56.945821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5951a11-c933-48ca-a23c-2fc590f0d473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:56.947408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5951a11-c933-48ca-a23c-2fc590f0d473 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:56.956508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 656/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:35:59.108718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244ea5-37c4-4bd7-942a-dd3056ee9044 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:59.109283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244ea5-37c4-4bd7-942a-dd3056ee9044 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:59.109283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244ea5-37c4-4bd7-942a-dd3056ee9044 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:59.111006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 656/1312] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:35:59.117068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252fd9-54b8-4e15-b67e-335fb974aa58 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:59.117485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252fd9-54b8-4e15-b67e-335fb974aa58 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:59.117651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7252fd9-54b8-4e15-b67e-335fb974aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:59.139649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f7252fd9-54b8-4e15-b67e-335fb974aa58 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:35:59.140836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f7252fd9-54b8-4e15-b67e-335fb974aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:35:59.148042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 657/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:35:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:35:59.192240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244ea5-37c4-4bd7-942a-dd3056ee9044 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:35:59.205599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244ea5-37c4-4bd7-942a-dd3056ee9044 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:35:59.211157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29834d96-2630-4cf8-bf31-b560c62f1c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:35:59.211722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834d96-2630-4cf8-bf31-b560c62f1c78 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:35:59.212050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834d96-2630-4cf8-bf31-b560c62f1c78 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:35:59.212340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834d96-2630-4cf8-bf31-b560c62f1c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:35:59.220158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29834d96-2630-4cf8-bf31-b560c62f1c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:35:59.221722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29834d96-2630-4cf8-bf31-b560c62f1c78 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:35:59.231135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 657/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:35:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:01.397646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9896c6-a37e-4b10-9770-dbffbf0fb770 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:01.398238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9896c6-a37e-4b10-9770-dbffbf0fb770 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:01.398385 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9896c6-a37e-4b10-9770-dbffbf0fb770 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:01.400269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 658/1315] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:36:01.405359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26d047-dc21-4f2c-aa54-f69e6cb4b691 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:01.405747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26d047-dc21-4f2c-aa54-f69e6cb4b691 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:01.405943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26d047-dc21-4f2c-aa54-f69e6cb4b691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:01.429079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-bb26d047-dc21-4f2c-aa54-f69e6cb4b691 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:01.430230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bb26d047-dc21-4f2c-aa54-f69e6cb4b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:01.437334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 658/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:01.481998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9896c6-a37e-4b10-9770-dbffbf0fb770 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:01.495793 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9896c6-a37e-4b10-9770-dbffbf0fb770 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:01.501230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a5919-cbbc-45df-ab8f-76bc31eea77d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:01.501819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5919-cbbc-45df-ab8f-76bc31eea77d service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:01.502164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5919-cbbc-45df-ab8f-76bc31eea77d service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:01.502455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a5919-cbbc-45df-ab8f-76bc31eea77d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:01.510917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a5919-cbbc-45df-ab8f-76bc31eea77d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:01.512540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a5919-cbbc-45df-ab8f-76bc31eea77d service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:01.521907 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 659/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:03.667851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3919a1-c545-43a7-920a-9a93f890f0d2 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:03.668441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3919a1-c545-43a7-920a-9a93f890f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:03.668547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3919a1-c545-43a7-920a-9a93f890f0d2 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:03.670153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 659/1318] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:03.675456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee64ff-1e8c-43f2-8cb5-28ae11fd54ab None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:03.676097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee64ff-1e8c-43f2-8cb5-28ae11fd54ab None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:03.676097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee64ff-1e8c-43f2-8cb5-28ae11fd54ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:03.698911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6dee64ff-1e8c-43f2-8cb5-28ae11fd54ab None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:03.700079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6dee64ff-1e8c-43f2-8cb5-28ae11fd54ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:03.708054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 660/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:03.751591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3919a1-c545-43a7-920a-9a93f890f0d2 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:03.765218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3919a1-c545-43a7-920a-9a93f890f0d2 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:03.771184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c226bb-4614-4855-9a9f-4b6b35ad4266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:03.771756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c226bb-4614-4855-9a9f-4b6b35ad4266 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:03.772085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c226bb-4614-4855-9a9f-4b6b35ad4266 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:03.772372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c226bb-4614-4855-9a9f-4b6b35ad4266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:03.780165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c226bb-4614-4855-9a9f-4b6b35ad4266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:03.781728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c226bb-4614-4855-9a9f-4b6b35ad4266 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:03.792426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 660/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:14.198062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7395c-1f5e-49ee-bb60-51ef922e32f5 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:14.198647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7395c-1f5e-49ee-bb60-51ef922e32f5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:14.198647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7395c-1f5e-49ee-bb60-51ef922e32f5 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:14.200386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 661/1321] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:14.205690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162d2b7-d3ca-4334-9928-a2c8a1955240 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:14.206107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162d2b7-d3ca-4334-9928-a2c8a1955240 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:14.206895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162d2b7-d3ca-4334-9928-a2c8a1955240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:14.229847 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-9162d2b7-d3ca-4334-9928-a2c8a1955240 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:14.231006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9162d2b7-d3ca-4334-9928-a2c8a1955240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:14.238218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 661/1322] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:36:14.302707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb306745-bd6c-4fda-8b22-a7c7579da4c8 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:14.303006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb306745-bd6c-4fda-8b22-a7c7579da4c8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:14.303297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb306745-bd6c-4fda-8b22-a7c7579da4c8 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:14.305409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 662/1323] 10.222.0.23 () {54 vars in 961 bytes} [Fri Apr 8 02:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:14.310237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbf4ee-a665-4479-b33a-787f645a35e7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:14.310541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbf4ee-a665-4479-b33a-787f645a35e7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:14.310833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbf4ee-a665-4479-b33a-787f645a35e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:14.378352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c4fbf4ee-a665-4479-b33a-787f645a35e7 None None] MFA Rules not processed for user `0e240ede71df43708e2fb859c99b0a23`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:14.379561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c4fbf4ee-a665-4479-b33a-787f645a35e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:14.457196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 662/1324] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Apr 8 02:36:14 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:14.464697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb306745-bd6c-4fda-8b22-a7c7579da4c8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:14.476002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb306745-bd6c-4fda-8b22-a7c7579da4c8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:14.479488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff8481-4ef9-4361-a489-6474b22275ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:14.480102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff8481-4ef9-4361-a489-6474b22275ff service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:14.480401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff8481-4ef9-4361-a489-6474b22275ff service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:14.480688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff8481-4ef9-4361-a489-6474b22275ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:14.490609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff8481-4ef9-4361-a489-6474b22275ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:14.492069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff8481-4ef9-4361-a489-6474b22275ff service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:14.501754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 663/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:28.596321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35507d3-c770-4215-aa7f-60be71bfb9a9 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:28.596892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35507d3-c770-4215-aa7f-60be71bfb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:28.596892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35507d3-c770-4215-aa7f-60be71bfb9a9 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:28.598586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 663/1326] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:28.604041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cca04-745a-4f84-ae5a-902bea905d55 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:28.604469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cca04-745a-4f84-ae5a-902bea905d55 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:28.604629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cca04-745a-4f84-ae5a-902bea905d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:28.626806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a39cca04-745a-4f84-ae5a-902bea905d55 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:28.627975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a39cca04-745a-4f84-ae5a-902bea905d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:28.635723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 664/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:28.688528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da46904-6e8e-49ea-838f-2710a6f9603e None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:28.688822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da46904-6e8e-49ea-838f-2710a6f9603e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:28.689106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da46904-6e8e-49ea-838f-2710a6f9603e None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:28.690773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 664/1328] 10.222.0.23 () {54 vars in 961 bytes} [Fri Apr 8 02:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:28.698438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08692-6ddc-43f6-9e38-59a15e2a8a78 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:28.698746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08692-6ddc-43f6-9e38-59a15e2a8a78 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:28.699043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08692-6ddc-43f6-9e38-59a15e2a8a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:28.768207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e4d08692-6ddc-43f6-9e38-59a15e2a8a78 None None] MFA Rules not processed for user `9fbc37924fca422ea9b4865259c740f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:28.769313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e4d08692-6ddc-43f6-9e38-59a15e2a8a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:28.837737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 665/1329] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Apr 8 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:28.845624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da46904-6e8e-49ea-838f-2710a6f9603e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:28.855753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da46904-6e8e-49ea-838f-2710a6f9603e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:28.859079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f9d1c-6588-4a01-bf9f-3341ae43852f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:28.859647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9d1c-6588-4a01-bf9f-3341ae43852f service glance] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:28.859954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9d1c-6588-4a01-bf9f-3341ae43852f service glance] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:28.860250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f9d1c-6588-4a01-bf9f-3341ae43852f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:28.868868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f9d1c-6588-4a01-bf9f-3341ae43852f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:28.870286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f9d1c-6588-4a01-bf9f-3341ae43852f service glance] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:28.879376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 665/1330] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:36:29.297024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302f2e-0b2c-4382-956c-014415d6de5b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.297322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302f2e-0b2c-4382-956c-014415d6de5b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.297610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9302f2e-0b2c-4382-956c-014415d6de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.363781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a9302f2e-0b2c-4382-956c-014415d6de5b None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:29.365590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a9302f2e-0b2c-4382-956c-014415d6de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:29.439563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 666/1331] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:29.480320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b302a3e-ad64-44e7-9dce-088e76183cc0 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.480715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b302a3e-ad64-44e7-9dce-088e76183cc0 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.481066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b302a3e-ad64-44e7-9dce-088e76183cc0 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.483010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 666/1332] 10.222.0.23 () {54 vars in 942 bytes} [Fri Apr 8 02:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:29.489669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccda7f6-6ba0-453d-bc7e-bd83611f365c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.490004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccda7f6-6ba0-453d-bc7e-bd83611f365c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.490306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccda7f6-6ba0-453d-bc7e-bd83611f365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.559937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5ccda7f6-6ba0-453d-bc7e-bd83611f365c None None] MFA Rules not processed for user `7dcb623e589c4b17a7a9b3b022c51f96`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:29.561126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5ccda7f6-6ba0-453d-bc7e-bd83611f365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:29.639814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 667/1333] 10.222.0.23 () {58 vars in 1039 bytes} [Fri Apr 8 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3734 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:29.649879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b302a3e-ad64-44e7-9dce-088e76183cc0 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:29.662805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b302a3e-ad64-44e7-9dce-088e76183cc0 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:29.667374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba106cf1-8aba-4bfb-93f3-38858cbeeff1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:29.667965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba106cf1-8aba-4bfb-93f3-38858cbeeff1 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:29.668262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba106cf1-8aba-4bfb-93f3-38858cbeeff1 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:29.668552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba106cf1-8aba-4bfb-93f3-38858cbeeff1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:29.676346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba106cf1-8aba-4bfb-93f3-38858cbeeff1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:29.678040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba106cf1-8aba-4bfb-93f3-38858cbeeff1 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:29.686257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 667/1334] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:36:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:36:46.873644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c1ca-85fc-4f2c-bdc4-67280b1fd111 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:46.874261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c1ca-85fc-4f2c-bdc4-67280b1fd111 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:46.874261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3c1ca-85fc-4f2c-bdc4-67280b1fd111 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:46.875982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 668/1335] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:46.881930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935c20-3afd-48b6-98ce-7a6893f955f9 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:46.882360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935c20-3afd-48b6-98ce-7a6893f955f9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:46.882508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30935c20-3afd-48b6-98ce-7a6893f955f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:46.905160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-30935c20-3afd-48b6-98ce-7a6893f955f9 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:46.906300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-30935c20-3afd-48b6-98ce-7a6893f955f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:46.913716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 668/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:36:46.937066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c1ca-85fc-4f2c-bdc4-67280b1fd111 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:46.949523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3c1ca-85fc-4f2c-bdc4-67280b1fd111 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:46.953726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0a217-4a13-4e0b-b439-7610ad874169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:46.954311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0a217-4a13-4e0b-b439-7610ad874169 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:46.954603 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0a217-4a13-4e0b-b439-7610ad874169 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:46.954890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0a217-4a13-4e0b-b439-7610ad874169 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:46.955595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0a217-4a13-4e0b-b439-7610ad874169 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:46.958184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0a217-4a13-4e0b-b439-7610ad874169 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:46.972521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 669/1337] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:36:46 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:36:49.046093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239648-cd37-4614-935f-b87c56d60635 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:49.046668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239648-cd37-4614-935f-b87c56d60635 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:49.046668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7239648-cd37-4614-935f-b87c56d60635 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:49.048407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 669/1338] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:49.053829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbeb3a9-e998-4b29-97be-cc604104a9b7 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:49.054509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbeb3a9-e998-4b29-97be-cc604104a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:49.054661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbeb3a9-e998-4b29-97be-cc604104a9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:49.076872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9bbeb3a9-e998-4b29-97be-cc604104a9b7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:49.078029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9bbeb3a9-e998-4b29-97be-cc604104a9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:49.086096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 670/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:49.109544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7239648-cd37-4614-935f-b87c56d60635 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:49.122972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7239648-cd37-4614-935f-b87c56d60635 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:49.127100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:49.127880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:49.128194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:49.128478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] PATH_INFO: `/v3/projects/34ddce90037c4fbb82757aded33c6c12` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:49.130555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] RBAC: Authorizing `identity:get_project(project_id=34ddce90037c4fbb82757aded33c6c12)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:49.132362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:49.133900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 670/1340] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:49 2022] GET /identity/v3/projects/34ddce90037c4fbb82757aded33c6c12 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:49.140005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbeb3a9-e998-4b29-97be-cc604104a9b7 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:49.149602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbeb3a9-e998-4b29-97be-cc604104a9b7 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:49.153854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f735ed6-ceed-4590-9106-73fb01973c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:49.154435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735ed6-ceed-4590-9106-73fb01973c73 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:49.154730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735ed6-ceed-4590-9106-73fb01973c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:49.155022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f735ed6-ceed-4590-9106-73fb01973c73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:49.155750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f735ed6-ceed-4590-9106-73fb01973c73 admin admin] RBAC: Adding query filter params (scope.project.id=34ddce90037c4fbb82757aded33c6c12) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:36:49.156092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f735ed6-ceed-4590-9106-73fb01973c73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:49.157966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f735ed6-ceed-4590-9106-73fb01973c73 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:49.163757 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 671/1341] 10.222.0.23 () {56 vars in 1231 bytes} [Fri Apr 8 02:36:49 2022] GET /identity/v3/role_assignments?scope.project.id=34ddce90037c4fbb82757aded33c6c12 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:49.169380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:49.179590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b0462-0de3-4aa0-9b10-bc475c3a6db0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:49.183893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26fd4-fdb2-4102-8d79-ee25addaa80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:49.184716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26fd4-fdb2-4102-8d79-ee25addaa80f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:49.185011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26fd4-fdb2-4102-8d79-ee25addaa80f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:49.185301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26fd4-fdb2-4102-8d79-ee25addaa80f admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:49.186394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa26fd4-fdb2-4102-8d79-ee25addaa80f admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:49.188188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa26fd4-fdb2-4102-8d79-ee25addaa80f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:49.189640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 671/1342] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:36:49 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:36:51.353286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207aea-9670-42b6-a6e4-d331bd32b6c2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:51.353858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207aea-9670-42b6-a6e4-d331bd32b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:51.353858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc207aea-9670-42b6-a6e4-d331bd32b6c2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:51.355579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 672/1343] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:51.360974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8628d6-17e8-41cd-889d-904bc0868d14 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:51.361430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8628d6-17e8-41cd-889d-904bc0868d14 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:51.361557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8628d6-17e8-41cd-889d-904bc0868d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:51.384149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8c8628d6-17e8-41cd-889d-904bc0868d14 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:51.385307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8c8628d6-17e8-41cd-889d-904bc0868d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:51.392475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 672/1344] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:51.415507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207aea-9670-42b6-a6e4-d331bd32b6c2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:51.428128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc207aea-9670-42b6-a6e4-d331bd32b6c2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:51.432713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:51.433526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:51.433816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:51.434104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] PATH_INFO: `/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:51.446237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] RBAC: Authorizing `identity:get_project(project_id=3cc928cf48004c2999961f3ddf9e8c9b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:51.448320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:51.449899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 673/1345] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:51 2022] GET /identity/v3/projects/3cc928cf48004c2999961f3ddf9e8c9b => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:51.455995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8628d6-17e8-41cd-889d-904bc0868d14 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:51.464783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8628d6-17e8-41cd-889d-904bc0868d14 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:51.469159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec47c4-5746-4340-bdda-da788ff3f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:51.469739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec47c4-5746-4340-bdda-da788ff3f6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:51.470033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec47c4-5746-4340-bdda-da788ff3f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:51.470324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec47c4-5746-4340-bdda-da788ff3f6f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:51.471053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec47c4-5746-4340-bdda-da788ff3f6f0 admin admin] RBAC: Adding query filter params (scope.project.id=3cc928cf48004c2999961f3ddf9e8c9b) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:36:51.471357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec47c4-5746-4340-bdda-da788ff3f6f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:51.473738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec47c4-5746-4340-bdda-da788ff3f6f0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:51.479202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 673/1346] 10.222.0.23 () {56 vars in 1231 bytes} [Fri Apr 8 02:36:51 2022] GET /identity/v3/role_assignments?scope.project.id=3cc928cf48004c2999961f3ddf9e8c9b => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:51.484684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:51.494700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30aabc-e143-4cc0-ace7-aadd0be78fec admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:51.498936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc007-20ba-4e3d-951d-d8b955616aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:51.499724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc007-20ba-4e3d-951d-d8b955616aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:51.500048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc007-20ba-4e3d-951d-d8b955616aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:51.500331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc007-20ba-4e3d-951d-d8b955616aa4 admin admin] PATH_INFO: `/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:51.518928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc007-20ba-4e3d-951d-d8b955616aa4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a9a4c6ac3add45dc9472ce5b29e0dc3e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:51.521265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aafc007-20ba-4e3d-951d-d8b955616aa4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:51.522787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 674/1347] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:36:51 2022] GET /identity/v3/users/a9a4c6ac3add45dc9472ce5b29e0dc3e => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:53.650485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dade4e-0a58-4d6a-b81a-d2ee01528b0b None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:53.651039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dade4e-0a58-4d6a-b81a-d2ee01528b0b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:53.651134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dade4e-0a58-4d6a-b81a-d2ee01528b0b None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:53.652804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 674/1348] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:53.657802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdce31-5bac-4195-ae4c-df51d89ac949 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:53.658201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdce31-5bac-4195-ae4c-df51d89ac949 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:53.658372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fdce31-5bac-4195-ae4c-df51d89ac949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:53.681286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-82fdce31-5bac-4195-ae4c-df51d89ac949 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:53.682423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-82fdce31-5bac-4195-ae4c-df51d89ac949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:53.689409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 675/1349] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:53.711751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dade4e-0a58-4d6a-b81a-d2ee01528b0b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:53.724065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dade4e-0a58-4d6a-b81a-d2ee01528b0b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:53.728197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:53.728973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:53.729264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:53.729549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] PATH_INFO: `/v3/projects/8171955e389f4a1a826c727a9e49cde7` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:53.742222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] RBAC: Authorizing `identity:get_project(project_id=8171955e389f4a1a826c727a9e49cde7)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:53.744303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:53.745836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 675/1350] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:53 2022] GET /identity/v3/projects/8171955e389f4a1a826c727a9e49cde7 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:36:53.751656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdce31-5bac-4195-ae4c-df51d89ac949 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:53.760376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fdce31-5bac-4195-ae4c-df51d89ac949 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:53.764499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6219-3416-46b6-a96c-583fb38c4d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:53.765070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6219-3416-46b6-a96c-583fb38c4d53 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:53.765358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6219-3416-46b6-a96c-583fb38c4d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:53.765642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6219-3416-46b6-a96c-583fb38c4d53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:53.766366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae6219-3416-46b6-a96c-583fb38c4d53 admin admin] RBAC: Adding query filter params (scope.project.id=8171955e389f4a1a826c727a9e49cde7) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:36:53.766667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae6219-3416-46b6-a96c-583fb38c4d53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:53.768523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae6219-3416-46b6-a96c-583fb38c4d53 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:53.773958 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 676/1351] 10.222.0.23 () {56 vars in 1231 bytes} [Fri Apr 8 02:36:53 2022] GET /identity/v3/role_assignments?scope.project.id=8171955e389f4a1a826c727a9e49cde7 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:53.779466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:53.789353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd9e23-1edc-4cf0-81f8-eee0bf9d1c8a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:53.793711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904dfed-27f0-4979-884f-847984dbabd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:53.794493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904dfed-27f0-4979-884f-847984dbabd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:53.794786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904dfed-27f0-4979-884f-847984dbabd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:53.795071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904dfed-27f0-4979-884f-847984dbabd4 admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:53.814773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904dfed-27f0-4979-884f-847984dbabd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:53.816976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904dfed-27f0-4979-884f-847984dbabd4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:53.818494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 676/1352] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:36:53 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:55.942589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c01e-340d-4d6a-aff6-164d96e5d1b1 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:55.943161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c01e-340d-4d6a-aff6-164d96e5d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:55.943161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8c01e-340d-4d6a-aff6-164d96e5d1b1 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:55.944851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 677/1353] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:55.949884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2328e-4b83-41e4-8c5e-77b81f575b43 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:55.950302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2328e-4b83-41e4-8c5e-77b81f575b43 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:55.950453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2328e-4b83-41e4-8c5e-77b81f575b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:55.972922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3ef2328e-4b83-41e4-8c5e-77b81f575b43 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:55.974659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3ef2328e-4b83-41e4-8c5e-77b81f575b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:55.981816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 677/1354] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:56.004738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c01e-340d-4d6a-aff6-164d96e5d1b1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:56.016700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8c01e-340d-4d6a-aff6-164d96e5d1b1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:56.021425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:56.022200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:56.022492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:56.022778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] PATH_INFO: `/v3/projects/b1ef151b81c542ee8448775f8b547988` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:56.034489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] RBAC: Authorizing `identity:get_project(project_id=b1ef151b81c542ee8448775f8b547988)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:56.036729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:56.038273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 678/1355] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:56 2022] GET /identity/v3/projects/b1ef151b81c542ee8448775f8b547988 => generated 361 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:56.044264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2328e-4b83-41e4-8c5e-77b81f575b43 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:56.053060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2328e-4b83-41e4-8c5e-77b81f575b43 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:56.057660 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929daf71-c8e8-47f0-a29b-f2453e8892fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:56.058239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929daf71-c8e8-47f0-a29b-f2453e8892fe admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:56.058536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929daf71-c8e8-47f0-a29b-f2453e8892fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:56.058829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929daf71-c8e8-47f0-a29b-f2453e8892fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:56.059565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929daf71-c8e8-47f0-a29b-f2453e8892fe admin admin] RBAC: Adding query filter params (scope.project.id=b1ef151b81c542ee8448775f8b547988) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:36:56.059871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929daf71-c8e8-47f0-a29b-f2453e8892fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:56.061832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929daf71-c8e8-47f0-a29b-f2453e8892fe admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:56.067672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 678/1356] 10.222.0.23 () {56 vars in 1231 bytes} [Fri Apr 8 02:36:56 2022] GET /identity/v3/role_assignments?scope.project.id=b1ef151b81c542ee8448775f8b547988 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:56.073160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:56.082898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d36f06-d3ec-450d-81bf-d1bf262a1cda admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:56.087201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47c62b-82b6-4f9d-af7f-f2806eba585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:56.088033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47c62b-82b6-4f9d-af7f-f2806eba585d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:56.088319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47c62b-82b6-4f9d-af7f-f2806eba585d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:56.088599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47c62b-82b6-4f9d-af7f-f2806eba585d admin admin] PATH_INFO: `/v3/users/3c845bc69ded4b81b773f953bf3eae2d` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:56.111203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47c62b-82b6-4f9d-af7f-f2806eba585d admin admin] RBAC: Authorizing `identity:get_user(user_id=3c845bc69ded4b81b773f953bf3eae2d)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:56.113587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47c62b-82b6-4f9d-af7f-f2806eba585d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:56.115252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 679/1357] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:36:56 2022] GET /identity/v3/users/3c845bc69ded4b81b773f953bf3eae2d => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:58.261272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4a9b2-6eac-4990-b593-3c61490b1117 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:58.261835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4a9b2-6eac-4990-b593-3c61490b1117 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:58.261940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4a9b2-6eac-4990-b593-3c61490b1117 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:58.263557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 679/1358] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:36:58.268784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3447-6775-43b6-a0f9-a3fd936a8927 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:58.269178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3447-6775-43b6-a0f9-a3fd936a8927 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:58.270045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3447-6775-43b6-a0f9-a3fd936a8927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:58.292321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-470e3447-6775-43b6-a0f9-a3fd936a8927 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:36:58.293465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-470e3447-6775-43b6-a0f9-a3fd936a8927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:36:58.300552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 680/1359] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:36:58.324324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4a9b2-6eac-4990-b593-3c61490b1117 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:58.336692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4a9b2-6eac-4990-b593-3c61490b1117 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:58.340875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:58.341656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:58.341948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:58.342238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] PATH_INFO: `/v3/projects/cd9845ead80548eca895b91aae981fe7` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:58.354692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] RBAC: Authorizing `identity:get_project(project_id=cd9845ead80548eca895b91aae981fe7)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:58.356769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:58.358300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 680/1360] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:36:58 2022] GET /identity/v3/projects/cd9845ead80548eca895b91aae981fe7 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:58.364864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3447-6775-43b6-a0f9-a3fd936a8927 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:58.373666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3447-6775-43b6-a0f9-a3fd936a8927 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:58.378119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:58.378699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:58.378994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:58.379284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:58.380102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] RBAC: Adding query filter params (scope.project.id=cd9845ead80548eca895b91aae981fe7) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:36:58.380410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:58.382242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:58.387877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 681/1361] 10.222.0.23 () {56 vars in 1231 bytes} [Fri Apr 8 02:36:58 2022] GET /identity/v3/role_assignments?scope.project.id=cd9845ead80548eca895b91aae981fe7 => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:36:58.393390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:58.403151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eabaac-902b-42b2-88a1-9a0df1c9e320 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:58.407397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba343a-2e61-4e45-a951-daaf9ea219e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:58.408207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba343a-2e61-4e45-a951-daaf9ea219e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:58.408503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba343a-2e61-4e45-a951-daaf9ea219e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:58.408791 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba343a-2e61-4e45-a951-daaf9ea219e9 admin admin] PATH_INFO: `/v3/users/366894f2ce724c4ca664fce40880f7c8` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:58.427882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba343a-2e61-4e45-a951-daaf9ea219e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=366894f2ce724c4ca664fce40880f7c8)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:58.430314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba343a-2e61-4e45-a951-daaf9ea219e9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:58.431820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 681/1362] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:36:58 2022] GET /identity/v3/users/366894f2ce724c4ca664fce40880f7c8 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:36:58.437873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:36:58.447428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21919cc-dd74-45a1-bf34-8f511f41a83f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:36:58.451877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2afe-f471-4a95-bb00-727dd13467b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:36:58.452733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2afe-f471-4a95-bb00-727dd13467b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:36:58.453028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2afe-f471-4a95-bb00-727dd13467b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:36:58.453316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2afe-f471-4a95-bb00-727dd13467b7 admin admin] PATH_INFO: `/v3/users/a60b610b1d3a4fd2afa50109e84a7cde` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:36:58.473987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2afe-f471-4a95-bb00-727dd13467b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=a60b610b1d3a4fd2afa50109e84a7cde)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:36:58.476138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2afe-f471-4a95-bb00-727dd13467b7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:36:58.477650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 682/1363] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:36:58 2022] GET /identity/v3/users/a60b610b1d3a4fd2afa50109e84a7cde => generated 285 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:37:00.662525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de691-767d-45f7-8e45-277732f8b047 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.663101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de691-767d-45f7-8e45-277732f8b047 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.663101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de691-767d-45f7-8e45-277732f8b047 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.664820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 682/1364] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:00.669927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0a274-a765-4aa1-9e72-92c9249f27de None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.670419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0a274-a765-4aa1-9e72-92c9249f27de None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.670523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0a274-a765-4aa1-9e72-92c9249f27de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.693556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-60b0a274-a765-4aa1-9e72-92c9249f27de None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:00.694709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-60b0a274-a765-4aa1-9e72-92c9249f27de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:00.701807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 683/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:37:00.724448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8de691-767d-45f7-8e45-277732f8b047 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:00.736334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8de691-767d-45f7-8e45-277732f8b047 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:00.741048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:00.741822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.742114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.742433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] PATH_INFO: `/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.754711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] RBAC: Authorizing `identity:get_project(project_id=f0fa633b97da43ea83a6bfe98cf63dd1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:00.756829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:00.758314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 683/1366] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:37:00 2022] GET /identity/v3/projects/f0fa633b97da43ea83a6bfe98cf63dd1 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:37:00.764230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0a274-a765-4aa1-9e72-92c9249f27de None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:00.772953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0a274-a765-4aa1-9e72-92c9249f27de None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:00.777207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:00.777786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.778079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.778367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.779100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] RBAC: Adding query filter params (scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:37:00.779403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:00.781269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:00.787798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 684/1367] 10.222.0.23 () {56 vars in 1231 bytes} [Fri Apr 8 02:37:00 2022] GET /identity/v3/role_assignments?scope.project.id=f0fa633b97da43ea83a6bfe98cf63dd1 => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:37:00.793637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:00.803452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ec743-7e48-466a-af82-54bb62bf0aeb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:00.808052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d8068-6bf2-4157-bb25-dc7ea4a4b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:00.808837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d8068-6bf2-4157-bb25-dc7ea4a4b9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.809128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d8068-6bf2-4157-bb25-dc7ea4a4b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.809411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d8068-6bf2-4157-bb25-dc7ea4a4b9e2 admin admin] PATH_INFO: `/v3/users/473ad4d219da45e08d7d3ad8b07ae180` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.810528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d8068-6bf2-4157-bb25-dc7ea4a4b9e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=473ad4d219da45e08d7d3ad8b07ae180)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:00.812624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d8068-6bf2-4157-bb25-dc7ea4a4b9e2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:00.814047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 684/1368] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:37:00 2022] GET /identity/v3/users/473ad4d219da45e08d7d3ad8b07ae180 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:37:00.820071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:00.829474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086a39e-5432-4329-a9ca-a888a93f9809 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:00.833816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495134-bed1-4734-801e-c51f5908dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:00.834592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495134-bed1-4734-801e-c51f5908dfcb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:00.834881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495134-bed1-4734-801e-c51f5908dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:00.835163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495134-bed1-4734-801e-c51f5908dfcb admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:00.836285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495134-bed1-4734-801e-c51f5908dfcb admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:00.838038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495134-bed1-4734-801e-c51f5908dfcb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:00.839457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 685/1369] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:37:00 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:37:03.048511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9965bf-fac1-4eb4-9f11-fefe070d2ae7 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:03.049158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9965bf-fac1-4eb4-9f11-fefe070d2ae7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:03.049158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9965bf-fac1-4eb4-9f11-fefe070d2ae7 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:03.051255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 685/1370] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:03.056879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ad70-4db4-441d-af11-663969304eb8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:03.057312 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ad70-4db4-441d-af11-663969304eb8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:03.057476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558ad70-4db4-441d-af11-663969304eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:03.079707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-7558ad70-4db4-441d-af11-663969304eb8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:03.080885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7558ad70-4db4-441d-af11-663969304eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:03.088486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 686/1371] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:37:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:03.110491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9965bf-fac1-4eb4-9f11-fefe070d2ae7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:03.123021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9965bf-fac1-4eb4-9f11-fefe070d2ae7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:03.127197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:03.128005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:03.128301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:03.129253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] PATH_INFO: `/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:03.141083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] RBAC: Authorizing `identity:get_project(project_id=f3f49eab4461490fb0e5fea5d6ca05b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:03.143125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:03.144822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 686/1372] 10.222.0.23 () {56 vars in 1207 bytes} [Fri Apr 8 02:37:03 2022] GET /identity/v3/projects/f3f49eab4461490fb0e5fea5d6ca05b2 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:37:03.150592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ad70-4db4-441d-af11-663969304eb8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:03.159242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558ad70-4db4-441d-af11-663969304eb8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:03.163620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:03.164234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:03.164524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:03.164807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:03.165529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] RBAC: Adding query filter params (scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:37:03.165830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:03.167656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:03.174551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 687/1373] 10.222.0.23 () {56 vars in 1231 bytes} [Fri Apr 8 02:37:03 2022] GET /identity/v3/role_assignments?scope.project.id=f3f49eab4461490fb0e5fea5d6ca05b2 => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:37:03.180934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:03.190075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f94540-7f2e-4fff-9454-bd5249e6b0ee admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:03.194865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298f4c4-e3af-4636-bf84-81e862b92adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:03.195645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298f4c4-e3af-4636-bf84-81e862b92adb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:03.195961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298f4c4-e3af-4636-bf84-81e862b92adb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:03.196256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298f4c4-e3af-4636-bf84-81e862b92adb admin admin] PATH_INFO: `/v3/users/c7f64b1e79994a23a6fbc99fe8cef153` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:03.197358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298f4c4-e3af-4636-bf84-81e862b92adb admin admin] RBAC: Authorizing `identity:get_user(user_id=c7f64b1e79994a23a6fbc99fe8cef153)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:03.199119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298f4c4-e3af-4636-bf84-81e862b92adb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:03.200585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 687/1374] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:37:03 2022] GET /identity/v3/users/c7f64b1e79994a23a6fbc99fe8cef153 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:37:03.205818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:03.214998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db673f7-c9eb-4e8c-80b9-80cda2777165 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:03.219264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dd187-0ee1-480c-9437-1f10d799c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:03.220081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd187-0ee1-480c-9437-1f10d799c2af admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:03.220377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd187-0ee1-480c-9437-1f10d799c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:03.220667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dd187-0ee1-480c-9437-1f10d799c2af admin admin] PATH_INFO: `/v3/users/6c6d4d4d250345d6aad47f0e2e83304e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:03.240100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dd187-0ee1-480c-9437-1f10d799c2af admin admin] RBAC: Authorizing `identity:get_user(user_id=6c6d4d4d250345d6aad47f0e2e83304e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:03.242246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dd187-0ee1-480c-9437-1f10d799c2af admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:03.243719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 688/1375] 10.222.0.23 () {56 vars in 1198 bytes} [Fri Apr 8 02:37:03 2022] GET /identity/v3/users/6c6d4d4d250345d6aad47f0e2e83304e => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:37:08.362103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595bced-62be-4781-9117-2a9e063d5004 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:08.362628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595bced-62be-4781-9117-2a9e063d5004 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:08.363030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595bced-62be-4781-9117-2a9e063d5004 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:08.364526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 688/1376] 10.222.0.23 () {54 vars in 918 bytes} [Fri Apr 8 02:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:08.369640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c86c-535f-4d21-b374-d697f4d35533 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:08.370073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c86c-535f-4d21-b374-d697f4d35533 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:08.370224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c86c-535f-4d21-b374-d697f4d35533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:08.395503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-73c6c86c-535f-4d21-b374-d697f4d35533 None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:08.396717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-73c6c86c-535f-4d21-b374-d697f4d35533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:08.404489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 689/1377] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Apr 8 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:08.419718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec88d-6bbb-4736-bbdd-16ca749adadf None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:08.420045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec88d-6bbb-4736-bbdd-16ca749adadf None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:08.420366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcec88d-6bbb-4736-bbdd-16ca749adadf None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:08.422436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 689/1378] 10.222.0.23 () {54 vars in 918 bytes} [Fri Apr 8 02:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:08.428008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a519c-6a58-494e-943c-a77cfe60996f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:08.428306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a519c-6a58-494e-943c-a77cfe60996f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:08.428610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a519c-6a58-494e-943c-a77cfe60996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:08.451910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bb9a519c-6a58-494e-943c-a77cfe60996f None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:08.453081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bb9a519c-6a58-494e-943c-a77cfe60996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:08.462328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 690/1379] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Apr 8 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:10.992000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1f96-9845-42b7-9a57-117cf7d7ec82 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:10.992579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1f96-9845-42b7-9a57-117cf7d7ec82 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:10.992579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e1f96-9845-42b7-9a57-117cf7d7ec82 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:10.994228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 690/1380] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:10.999515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300c98-95f1-4f17-bb68-f370ec7e1640 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:10.999910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300c98-95f1-4f17-bb68-f370ec7e1640 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:11.000141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98300c98-95f1-4f17-bb68-f370ec7e1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:11.022083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-98300c98-95f1-4f17-bb68-f370ec7e1640 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:11.023238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-98300c98-95f1-4f17-bb68-f370ec7e1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:11.030284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 691/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:11.073025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1f96-9845-42b7-9a57-117cf7d7ec82 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:11.086527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e1f96-9845-42b7-9a57-117cf7d7ec82 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:11.091558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb55734-574a-4de9-bea5-355c8a434c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:11.092155 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55734-574a-4de9-bea5-355c8a434c07 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:11.092449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55734-574a-4de9-bea5-355c8a434c07 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:11.092746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb55734-574a-4de9-bea5-355c8a434c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:11.101032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb55734-574a-4de9-bea5-355c8a434c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:11.102582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb55734-574a-4de9-bea5-355c8a434c07 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:11.111423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 691/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:12.514501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa0da-6cc4-4562-9ab9-b44fc2caaf7a None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:12.514995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa0da-6cc4-4562-9ab9-b44fc2caaf7a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:12.515098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2aa0da-6cc4-4562-9ab9-b44fc2caaf7a None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:12.516787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 692/1383] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:12.522442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3dbdb-6c10-4949-a152-e1b0edc00034 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:12.522839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3dbdb-6c10-4949-a152-e1b0edc00034 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:12.523032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3dbdb-6c10-4949-a152-e1b0edc00034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:12.545453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-62e3dbdb-6c10-4949-a152-e1b0edc00034 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:12.546604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-62e3dbdb-6c10-4949-a152-e1b0edc00034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:12.553674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 692/1384] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:12.705110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa0da-6cc4-4562-9ab9-b44fc2caaf7a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:12.718448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2aa0da-6cc4-4562-9ab9-b44fc2caaf7a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:12.723764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01768f3f-d5f1-4653-9b08-d8ef24d95665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:12.724379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768f3f-d5f1-4653-9b08-d8ef24d95665 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:12.724674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768f3f-d5f1-4653-9b08-d8ef24d95665 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:12.724961 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01768f3f-d5f1-4653-9b08-d8ef24d95665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:12.733001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01768f3f-d5f1-4653-9b08-d8ef24d95665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:12.734569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01768f3f-d5f1-4653-9b08-d8ef24d95665 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:12.743952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 693/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:12 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:14.158831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1706121-5329-41c3-a8b2-977c774ab5ae None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:14.159496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1706121-5329-41c3-a8b2-977c774ab5ae None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:14.159496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1706121-5329-41c3-a8b2-977c774ab5ae None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:14.161635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 693/1386] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:14.166550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c264e-f6fc-4ccc-85ad-cf41f80914aa None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:14.166995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c264e-f6fc-4ccc-85ad-cf41f80914aa None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:14.167142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c264e-f6fc-4ccc-85ad-cf41f80914aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:14.189816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a40c264e-f6fc-4ccc-85ad-cf41f80914aa None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:14.191565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a40c264e-f6fc-4ccc-85ad-cf41f80914aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:14.202075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 694/1387] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:14.351328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1706121-5329-41c3-a8b2-977c774ab5ae None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:14.365393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1706121-5329-41c3-a8b2-977c774ab5ae None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:14.370453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe2ac5-4f8a-42f5-b491-74f52afed6bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:14.371027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2ac5-4f8a-42f5-b491-74f52afed6bf service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:14.371323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2ac5-4f8a-42f5-b491-74f52afed6bf service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:14.371611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe2ac5-4f8a-42f5-b491-74f52afed6bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:14.380454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2ac5-4f8a-42f5-b491-74f52afed6bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:14.382039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe2ac5-4f8a-42f5-b491-74f52afed6bf service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:14.390878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 694/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:15.793377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d295-424e-4ef4-9b5f-05466e97118f None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:15.793892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d295-424e-4ef4-9b5f-05466e97118f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:15.793892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d295-424e-4ef4-9b5f-05466e97118f None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:15.795534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 695/1389] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:15.801427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31189330-146d-439d-bf69-6432e56e0ba6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:15.801822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31189330-146d-439d-bf69-6432e56e0ba6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:15.802008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31189330-146d-439d-bf69-6432e56e0ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:15.825258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-31189330-146d-439d-bf69-6432e56e0ba6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:15.826423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-31189330-146d-439d-bf69-6432e56e0ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:15.833830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 695/1390] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:15.984742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d295-424e-4ef4-9b5f-05466e97118f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:15.998747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d295-424e-4ef4-9b5f-05466e97118f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:16.004377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeeda4e-c181-4f2f-af61-078e38f65ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:16.004946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeda4e-c181-4f2f-af61-078e38f65ef3 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:16.005238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeda4e-c181-4f2f-af61-078e38f65ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:16.005548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeeda4e-c181-4f2f-af61-078e38f65ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:16.013424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeda4e-c181-4f2f-af61-078e38f65ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:16.014995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeeda4e-c181-4f2f-af61-078e38f65ef3 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:16.023795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 696/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:17.427424 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd5fa-51e9-4960-91d4-c24ef855439e None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:17.428033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd5fa-51e9-4960-91d4-c24ef855439e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:17.428033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadd5fa-51e9-4960-91d4-c24ef855439e None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:17.429944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 696/1392] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:17.434975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e88dc-442e-447a-a6ae-45d04fe6dcea None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:17.435355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e88dc-442e-447a-a6ae-45d04fe6dcea None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:17.435550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e88dc-442e-447a-a6ae-45d04fe6dcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:17.458323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-889e88dc-442e-447a-a6ae-45d04fe6dcea None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:17.459469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-889e88dc-442e-447a-a6ae-45d04fe6dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:17.466944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 697/1393] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:17.617072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd5fa-51e9-4960-91d4-c24ef855439e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:17.630995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadd5fa-51e9-4960-91d4-c24ef855439e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:17.636021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78577ec1-9633-4f97-9dfb-8cba69009135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:17.636585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577ec1-9633-4f97-9dfb-8cba69009135 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:17.636873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577ec1-9633-4f97-9dfb-8cba69009135 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:17.637160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78577ec1-9633-4f97-9dfb-8cba69009135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:17.644879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78577ec1-9633-4f97-9dfb-8cba69009135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:17.646887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78577ec1-9633-4f97-9dfb-8cba69009135 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:17.655662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 697/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:18.995317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c492b4-cdd3-4fe5-abee-b4042871e85e None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:18.995857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c492b4-cdd3-4fe5-abee-b4042871e85e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:18.996004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c492b4-cdd3-4fe5-abee-b4042871e85e None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:18.997674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 698/1395] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:19.002716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6673-3901-48d9-940e-1605fe05f8d1 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:19.003138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6673-3901-48d9-940e-1605fe05f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:19.003296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6673-3901-48d9-940e-1605fe05f8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:19.027690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e40b6673-3901-48d9-940e-1605fe05f8d1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:19.028866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e40b6673-3901-48d9-940e-1605fe05f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:19.035875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 698/1396] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:19.187976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c492b4-cdd3-4fe5-abee-b4042871e85e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:19.203098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c492b4-cdd3-4fe5-abee-b4042871e85e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:19.208811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74f2b7-0d58-4b20-af82-a52623c77e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:19.209386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f2b7-0d58-4b20-af82-a52623c77e13 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:19.209677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f2b7-0d58-4b20-af82-a52623c77e13 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:19.209964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74f2b7-0d58-4b20-af82-a52623c77e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:19.218072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74f2b7-0d58-4b20-af82-a52623c77e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:19.219647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74f2b7-0d58-4b20-af82-a52623c77e13 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:19.228636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 699/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:20.584212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b5231-b410-41e4-9245-a468b6800c80 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:20.584736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b5231-b410-41e4-9245-a468b6800c80 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:20.584834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b5231-b410-41e4-9245-a468b6800c80 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:20.586437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 699/1398] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:20.591508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85dbb6-7733-48e5-8c7b-44904d0b0924 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:20.591949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85dbb6-7733-48e5-8c7b-44904d0b0924 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:20.592111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85dbb6-7733-48e5-8c7b-44904d0b0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:20.614629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-ed85dbb6-7733-48e5-8c7b-44904d0b0924 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:20.615765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ed85dbb6-7733-48e5-8c7b-44904d0b0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:20.622828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 700/1399] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:20.770989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b5231-b410-41e4-9245-a468b6800c80 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:20.784677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b5231-b410-41e4-9245-a468b6800c80 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:20.790289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2724c7-2012-4a43-aee1-8eb5f22f152c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:20.790914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2724c7-2012-4a43-aee1-8eb5f22f152c service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:20.791214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2724c7-2012-4a43-aee1-8eb5f22f152c service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:20.791501 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2724c7-2012-4a43-aee1-8eb5f22f152c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:20.799448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2724c7-2012-4a43-aee1-8eb5f22f152c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:20.801064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2724c7-2012-4a43-aee1-8eb5f22f152c service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:20.810948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 700/1400] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:22.147380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5e42-94d2-4989-9a4a-fc1cdb189da2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:22.147983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5e42-94d2-4989-9a4a-fc1cdb189da2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:22.147983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5e42-94d2-4989-9a4a-fc1cdb189da2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:22.149684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 701/1401] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:22.154706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2f9f-9fb0-4e0d-91fc-d071baa41758 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:22.155102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2f9f-9fb0-4e0d-91fc-d071baa41758 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:22.155277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd2f9f-9fb0-4e0d-91fc-d071baa41758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:22.178517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-42fd2f9f-9fb0-4e0d-91fc-d071baa41758 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:22.179958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-42fd2f9f-9fb0-4e0d-91fc-d071baa41758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:22.186964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 701/1402] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:22.337418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5e42-94d2-4989-9a4a-fc1cdb189da2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:22.351193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5e42-94d2-4989-9a4a-fc1cdb189da2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:22.356117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce450-3591-44d1-90e5-63a7fe8e2a3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:22.356692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce450-3591-44d1-90e5-63a7fe8e2a3a service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:22.356984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce450-3591-44d1-90e5-63a7fe8e2a3a service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:22.357271 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce450-3591-44d1-90e5-63a7fe8e2a3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:22.365860 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ce450-3591-44d1-90e5-63a7fe8e2a3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:22.367434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ce450-3591-44d1-90e5-63a7fe8e2a3a service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:22.376275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 702/1403] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:23.736589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689441fe-1573-44c9-81de-74a9d7829c90 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:23.737147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689441fe-1573-44c9-81de-74a9d7829c90 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:23.737147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689441fe-1573-44c9-81de-74a9d7829c90 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:23.739568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 702/1404] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:23.744565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43126d-dff0-4a0a-a324-dc545786fbf9 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:23.744972 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43126d-dff0-4a0a-a324-dc545786fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:23.745137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43126d-dff0-4a0a-a324-dc545786fbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:23.767117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8e43126d-dff0-4a0a-a324-dc545786fbf9 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:23.768216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8e43126d-dff0-4a0a-a324-dc545786fbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:23.775962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 703/1405] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:23.928187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689441fe-1573-44c9-81de-74a9d7829c90 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:23.942026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689441fe-1573-44c9-81de-74a9d7829c90 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:23.947400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724d967-d199-41f3-ac5a-45d649953cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:23.947997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d967-d199-41f3-ac5a-45d649953cd6 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:23.948289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d967-d199-41f3-ac5a-45d649953cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:23.948575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d967-d199-41f3-ac5a-45d649953cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:23.956412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724d967-d199-41f3-ac5a-45d649953cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:23.958924 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724d967-d199-41f3-ac5a-45d649953cd6 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:23.968145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 703/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:26.019265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3bb0b-d91a-4de5-9d39-15dcf97fd85a None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:26.019827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3bb0b-d91a-4de5-9d39-15dcf97fd85a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:26.019827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3bb0b-d91a-4de5-9d39-15dcf97fd85a None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:26.022397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 704/1407] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:26.027592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d7a8-ddd0-45ec-8868-407a57ee94a8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:26.028021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d7a8-ddd0-45ec-8868-407a57ee94a8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:26.028200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d7a8-ddd0-45ec-8868-407a57ee94a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:26.050123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5186d7a8-ddd0-45ec-8868-407a57ee94a8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:26.051636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5186d7a8-ddd0-45ec-8868-407a57ee94a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:26.059010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 704/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:26.097209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3bb0b-d91a-4de5-9d39-15dcf97fd85a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:26.108040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3bb0b-d91a-4de5-9d39-15dcf97fd85a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:26.111381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431940a5-1a37-4462-86e2-e0830bca14c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:26.111969 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431940a5-1a37-4462-86e2-e0830bca14c9 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:26.112265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431940a5-1a37-4462-86e2-e0830bca14c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:26.112550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431940a5-1a37-4462-86e2-e0830bca14c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:26.122112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431940a5-1a37-4462-86e2-e0830bca14c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:26.123541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431940a5-1a37-4462-86e2-e0830bca14c9 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:26.132561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 705/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:26 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:28.382841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7322df-fc25-45e9-b742-d929f29d2ce5 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:28.383399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7322df-fc25-45e9-b742-d929f29d2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:28.383517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7322df-fc25-45e9-b742-d929f29d2ce5 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:28.385155 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 705/1410] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:28.390346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a33698-71cd-4623-aac0-9b461b2e1fd5 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:28.390737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a33698-71cd-4623-aac0-9b461b2e1fd5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:28.390922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a33698-71cd-4623-aac0-9b461b2e1fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:28.413886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-61a33698-71cd-4623-aac0-9b461b2e1fd5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:28.415022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-61a33698-71cd-4623-aac0-9b461b2e1fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:28.422174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 706/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:28.464267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7322df-fc25-45e9-b742-d929f29d2ce5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:28.475967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7322df-fc25-45e9-b742-d929f29d2ce5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:28.479314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19126019-64ea-41c4-9558-a721bc9cc970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:28.479886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19126019-64ea-41c4-9558-a721bc9cc970 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:28.480211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19126019-64ea-41c4-9558-a721bc9cc970 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:28.480496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19126019-64ea-41c4-9558-a721bc9cc970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:28.489622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19126019-64ea-41c4-9558-a721bc9cc970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:28.491052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19126019-64ea-41c4-9558-a721bc9cc970 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:28.500329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 706/1412] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:31.033628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7186fa8-119e-4134-8443-1d46e6562f89 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:31.034215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7186fa8-119e-4134-8443-1d46e6562f89 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:31.034215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7186fa8-119e-4134-8443-1d46e6562f89 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:31.036389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 707/1413] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:31.041784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d400-999a-43a9-9e85-b2cae95821fa None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:31.042195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d400-999a-43a9-9e85-b2cae95821fa None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:31.042359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d400-999a-43a9-9e85-b2cae95821fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:31.064940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5143d400-999a-43a9-9e85-b2cae95821fa None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:31.066084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5143d400-999a-43a9-9e85-b2cae95821fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:31.073315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 707/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:37:31.111959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7186fa8-119e-4134-8443-1d46e6562f89 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:31.123121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7186fa8-119e-4134-8443-1d46e6562f89 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:31.126567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b5dc4-9801-4863-a028-89dd24904447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:31.127147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b5dc4-9801-4863-a028-89dd24904447 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:31.127471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b5dc4-9801-4863-a028-89dd24904447 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:31.127759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b5dc4-9801-4863-a028-89dd24904447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:31.136875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b5dc4-9801-4863-a028-89dd24904447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:31.138688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b5dc4-9801-4863-a028-89dd24904447 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:31.147938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 708/1415] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:33.381022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50412c0-e08a-42ae-87dc-a820ee0e5ede None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:33.381679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50412c0-e08a-42ae-87dc-a820ee0e5ede None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:33.381679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50412c0-e08a-42ae-87dc-a820ee0e5ede None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:33.383368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 708/1416] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:33.388522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f57c1-0492-4a46-a665-bd902617f03b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:33.389045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f57c1-0492-4a46-a665-bd902617f03b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:33.389156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f57c1-0492-4a46-a665-bd902617f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:33.412636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c84f57c1-0492-4a46-a665-bd902617f03b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:33.413783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c84f57c1-0492-4a46-a665-bd902617f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:33.420767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 709/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:37:33.461404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50412c0-e08a-42ae-87dc-a820ee0e5ede None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:33.471949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50412c0-e08a-42ae-87dc-a820ee0e5ede None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:33.475916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56712b-92fe-4f99-bfa8-067ab650b236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:33.476510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56712b-92fe-4f99-bfa8-067ab650b236 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:33.476805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56712b-92fe-4f99-bfa8-067ab650b236 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:33.477090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56712b-92fe-4f99-bfa8-067ab650b236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:33.485720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56712b-92fe-4f99-bfa8-067ab650b236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:33.487137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56712b-92fe-4f99-bfa8-067ab650b236 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:33.496947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 709/1418] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:35.839945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0a6ef-3858-4413-80aa-0b6302f23f86 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:35.840488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0a6ef-3858-4413-80aa-0b6302f23f86 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:35.840597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0a6ef-3858-4413-80aa-0b6302f23f86 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:35.842217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 710/1419] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:35.847412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f2a0-8af7-4d2c-8799-7b211c2cb7be None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:35.848366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f2a0-8af7-4d2c-8799-7b211c2cb7be None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:35.848504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842f2a0-8af7-4d2c-8799-7b211c2cb7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:35.871364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e842f2a0-8af7-4d2c-8799-7b211c2cb7be None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:35.872590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e842f2a0-8af7-4d2c-8799-7b211c2cb7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:35.879786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 710/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:35.918198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0a6ef-3858-4413-80aa-0b6302f23f86 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:35.929659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0a6ef-3858-4413-80aa-0b6302f23f86 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:35.933032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b30ed-c330-43a2-b5bf-86d2a9e89ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:35.933598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b30ed-c330-43a2-b5bf-86d2a9e89ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:35.933889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b30ed-c330-43a2-b5bf-86d2a9e89ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:35.934173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b30ed-c330-43a2-b5bf-86d2a9e89ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:35.943517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b30ed-c330-43a2-b5bf-86d2a9e89ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:35.944973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b30ed-c330-43a2-b5bf-86d2a9e89ab4 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:35.954047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 711/1421] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:38.188820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af29c7-11f9-4f6f-a09f-40679d73dcd0 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:38.189406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af29c7-11f9-4f6f-a09f-40679d73dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:38.189406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af29c7-11f9-4f6f-a09f-40679d73dcd0 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:38.191056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 711/1422] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:38.199299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f261-6ce5-43d8-aa52-fe4f9dd7496c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:38.199299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f261-6ce5-43d8-aa52-fe4f9dd7496c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:38.199299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f261-6ce5-43d8-aa52-fe4f9dd7496c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:38.224922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-3a80f261-6ce5-43d8-aa52-fe4f9dd7496c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:38.226102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3a80f261-6ce5-43d8-aa52-fe4f9dd7496c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:38.235000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 712/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:38.283949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af29c7-11f9-4f6f-a09f-40679d73dcd0 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:38.295460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af29c7-11f9-4f6f-a09f-40679d73dcd0 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:38.300303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812715e-dbf5-4f34-96d1-1f0a4ad9091a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:38.301756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812715e-dbf5-4f34-96d1-1f0a4ad9091a service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:38.302126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812715e-dbf5-4f34-96d1-1f0a4ad9091a service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:38.302423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812715e-dbf5-4f34-96d1-1f0a4ad9091a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:38.314238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812715e-dbf5-4f34-96d1-1f0a4ad9091a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:38.316907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812715e-dbf5-4f34-96d1-1f0a4ad9091a service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:38.329112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 712/1424] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:40.648308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9140-174c-468e-b970-a6c0fdde9258 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.648896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9140-174c-468e-b970-a6c0fdde9258 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.648896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9140-174c-468e-b970-a6c0fdde9258 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.650524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 713/1425] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:40.655628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153fd26-028b-4ef0-b3a5-92903f46ea78 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.656106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153fd26-028b-4ef0-b3a5-92903f46ea78 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.656216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153fd26-028b-4ef0-b3a5-92903f46ea78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.679575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b153fd26-028b-4ef0-b3a5-92903f46ea78 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:40.680747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b153fd26-028b-4ef0-b3a5-92903f46ea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:40.687750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 713/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:40.726201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c9140-174c-468e-b970-a6c0fdde9258 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:40.736561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c9140-174c-468e-b970-a6c0fdde9258 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:40.740152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221e09-0a5b-4bc0-bab3-37e4c6d18c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:40.740715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221e09-0a5b-4bc0-bab3-37e4c6d18c4c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:40.741005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221e09-0a5b-4bc0-bab3-37e4c6d18c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:40.741286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221e09-0a5b-4bc0-bab3-37e4c6d18c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:40.750025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221e09-0a5b-4bc0-bab3-37e4c6d18c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:40.751446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221e09-0a5b-4bc0-bab3-37e4c6d18c4c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:40.760955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 714/1427] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:42.908743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2c31-b1f0-4558-b8c0-41a976a4ea41 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:42.909308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2c31-b1f0-4558-b8c0-41a976a4ea41 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:42.909308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2c31-b1f0-4558-b8c0-41a976a4ea41 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:42.911054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 714/1428] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:42.916193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a69f4-9997-4334-9cee-4268cd2aec0d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:42.916586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a69f4-9997-4334-9cee-4268cd2aec0d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:42.916768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a69f4-9997-4334-9cee-4268cd2aec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:42.939017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6e5a69f4-9997-4334-9cee-4268cd2aec0d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:42.940187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6e5a69f4-9997-4334-9cee-4268cd2aec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:42.947799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 715/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:42.985405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2c31-b1f0-4558-b8c0-41a976a4ea41 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:42.998145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2c31-b1f0-4558-b8c0-41a976a4ea41 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:43.001517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea91ea-bec9-401e-911d-3fa2b404d196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:43.002084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea91ea-bec9-401e-911d-3fa2b404d196 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:43.002376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea91ea-bec9-401e-911d-3fa2b404d196 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:43.002663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea91ea-bec9-401e-911d-3fa2b404d196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:43.013590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea91ea-bec9-401e-911d-3fa2b404d196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:43.015011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea91ea-bec9-401e-911d-3fa2b404d196 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:43.024330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 715/1430] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:45.189128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710473ef-6ac3-4cfd-9b04-c85fa6817a58 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:45.189692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710473ef-6ac3-4cfd-9b04-c85fa6817a58 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:45.189692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710473ef-6ac3-4cfd-9b04-c85fa6817a58 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:45.192162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 716/1431] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:45.197421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0f6b4-50a2-4c38-8223-ede856929e43 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:45.197853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0f6b4-50a2-4c38-8223-ede856929e43 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:45.198004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0f6b4-50a2-4c38-8223-ede856929e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:45.220000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-67c0f6b4-50a2-4c38-8223-ede856929e43 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:45.221321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-67c0f6b4-50a2-4c38-8223-ede856929e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:45.229144 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 716/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:37:45.265345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710473ef-6ac3-4cfd-9b04-c85fa6817a58 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:45.275731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710473ef-6ac3-4cfd-9b04-c85fa6817a58 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:45.279063 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc42c-6fb8-41b1-97d8-6a175478ed4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:45.279610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc42c-6fb8-41b1-97d8-6a175478ed4c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:45.279896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc42c-6fb8-41b1-97d8-6a175478ed4c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:45.280208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc42c-6fb8-41b1-97d8-6a175478ed4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:45.289260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc42c-6fb8-41b1-97d8-6a175478ed4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:45.290673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc42c-6fb8-41b1-97d8-6a175478ed4c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:45.299437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 717/1433] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:37:47.446649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9662-275c-43e4-a381-16aa968c1af9 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:47.447217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9662-275c-43e4-a381-16aa968c1af9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:47.447217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f9662-275c-43e4-a381-16aa968c1af9 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:47.448986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 717/1434] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:37:47.454234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a240-efef-41bf-b83d-25c48b1f50a8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:47.454640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a240-efef-41bf-b83d-25c48b1f50a8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:47.454934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707a240-efef-41bf-b83d-25c48b1f50a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:47.478007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-7707a240-efef-41bf-b83d-25c48b1f50a8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:37:47.479159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7707a240-efef-41bf-b83d-25c48b1f50a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:37:47.486406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 718/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:37:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:37:47.523400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f9662-275c-43e4-a381-16aa968c1af9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:37:47.533893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f9662-275c-43e4-a381-16aa968c1af9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:37:47.537511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83245d7e-e5ec-4258-9e46-f8d1c07c7a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:37:47.538085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83245d7e-e5ec-4258-9e46-f8d1c07c7a6c service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:37:47.538377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83245d7e-e5ec-4258-9e46-f8d1c07c7a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:37:47.538664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83245d7e-e5ec-4258-9e46-f8d1c07c7a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:37:47.547148 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83245d7e-e5ec-4258-9e46-f8d1c07c7a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:37:47.548636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83245d7e-e5ec-4258-9e46-f8d1c07c7a6c service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:37:47.558231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 718/1436] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:37:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:00.505677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703becd-0cae-415b-b1ce-36f5e603bea2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:00.506151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703becd-0cae-415b-b1ce-36f5e603bea2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:00.506269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703becd-0cae-415b-b1ce-36f5e603bea2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:00.507971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 719/1437] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:00.513296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d0db5-16f5-4355-89e2-3ea657a4b9f5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:00.513695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d0db5-16f5-4355-89e2-3ea657a4b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:00.513878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d0db5-16f5-4355-89e2-3ea657a4b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:00.536955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-606d0db5-16f5-4355-89e2-3ea657a4b9f5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:00.538112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-606d0db5-16f5-4355-89e2-3ea657a4b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:00.545246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 719/1438] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:00.590863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9d5a-3759-4fcb-9c18-516850a4660d None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:00.591189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9d5a-3759-4fcb-9c18-516850a4660d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:00.591475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9d5a-3759-4fcb-9c18-516850a4660d None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:00.593221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 720/1439] 10.222.0.23 () {54 vars in 961 bytes} [Fri Apr 8 02:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:00.598162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0a01-2e41-4929-8060-7eb89b88e13a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:00.598462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0a01-2e41-4929-8060-7eb89b88e13a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:00.598755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e0a01-2e41-4929-8060-7eb89b88e13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:00.621124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f81e0a01-2e41-4929-8060-7eb89b88e13a None None] MFA Rules not processed for user `9fbc37924fca422ea9b4865259c740f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:00.622262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f81e0a01-2e41-4929-8060-7eb89b88e13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:00.628674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 720/1440] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Apr 8 02:38:00 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:00.636391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d9d5a-3759-4fcb-9c18-516850a4660d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:00.646895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d9d5a-3759-4fcb-9c18-516850a4660d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:00.650250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2838702-864b-4c55-988e-48f6a14157bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:00.650815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838702-864b-4c55-988e-48f6a14157bb service glance] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:00.651104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838702-864b-4c55-988e-48f6a14157bb service glance] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:00.651390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2838702-864b-4c55-988e-48f6a14157bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:00.660365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2838702-864b-4c55-988e-48f6a14157bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:00.661785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2838702-864b-4c55-988e-48f6a14157bb service glance] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:38:00.670691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 721/1441] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:38:02.869158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758c45-7720-4b22-9fc0-233a53c95843 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:02.869743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758c45-7720-4b22-9fc0-233a53c95843 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:02.869743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758c45-7720-4b22-9fc0-233a53c95843 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:02.871713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 721/1442] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:02.877123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b16b-a2bb-4dc8-abb4-b5b31b14d075 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:02.877538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b16b-a2bb-4dc8-abb4-b5b31b14d075 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:02.877713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6b16b-a2bb-4dc8-abb4-b5b31b14d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:02.900027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9da6b16b-a2bb-4dc8-abb4-b5b31b14d075 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:02.901209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9da6b16b-a2bb-4dc8-abb4-b5b31b14d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:02.908216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 722/1443] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:38:02.932223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f758c45-7720-4b22-9fc0-233a53c95843 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:02.944195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f758c45-7720-4b22-9fc0-233a53c95843 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:02.948380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf558990-3fa7-4f31-9166-e06f47e7ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:02.948983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf558990-3fa7-4f31-9166-e06f47e7ef56 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:02.949275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf558990-3fa7-4f31-9166-e06f47e7ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:02.949559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf558990-3fa7-4f31-9166-e06f47e7ef56 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:02.950250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf558990-3fa7-4f31-9166-e06f47e7ef56 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:02.952097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf558990-3fa7-4f31-9166-e06f47e7ef56 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:38:02.966882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 722/1444] 10.222.0.23 () {56 vars in 1108 bytes} [Fri Apr 8 02:38:02 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:38:04.515683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46625d4e-1724-49a7-b3f1-dcfbaa82c7d3 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:04.516152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46625d4e-1724-49a7-b3f1-dcfbaa82c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:04.516324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46625d4e-1724-49a7-b3f1-dcfbaa82c7d3 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:04.518035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 723/1445] 10.222.0.23 () {54 vars in 911 bytes} [Fri Apr 8 02:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:04.523552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99f24-e77f-441f-bf5f-1a892b8351ec None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:04.524028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99f24-e77f-441f-bf5f-1a892b8351ec None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:04.524156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99f24-e77f-441f-bf5f-1a892b8351ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:04.546263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-88c99f24-e77f-441f-bf5f-1a892b8351ec None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:04.547416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-88c99f24-e77f-441f-bf5f-1a892b8351ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:04.554848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 723/1446] 10.222.0.23 () {58 vars in 1008 bytes} [Fri Apr 8 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:04.703185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46625d4e-1724-49a7-b3f1-dcfbaa82c7d3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:04.723269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46625d4e-1724-49a7-b3f1-dcfbaa82c7d3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:04.728383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dfbb5-ed80-41fd-ae38-e41fdd273bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:04.728963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dfbb5-ed80-41fd-ae38-e41fdd273bde service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:04.729258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dfbb5-ed80-41fd-ae38-e41fdd273bde service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:04.729547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dfbb5-ed80-41fd-ae38-e41fdd273bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:04.737807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dfbb5-ed80-41fd-ae38-e41fdd273bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:04.739413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dfbb5-ed80-41fd-ae38-e41fdd273bde service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:38:04.748383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 724/1447] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:06.911611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a04a-5da0-4d39-bd09-51446cca09e6 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:06.912206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a04a-5da0-4d39-bd09-51446cca09e6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:06.912206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93a04a-5da0-4d39-bd09-51446cca09e6 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:06.913860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 724/1448] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:06.918924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe41de-9a25-41f6-aece-4bc1857f1abe None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:06.919338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe41de-9a25-41f6-aece-4bc1857f1abe None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:06.919503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe41de-9a25-41f6-aece-4bc1857f1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:06.942080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-d2fe41de-9a25-41f6-aece-4bc1857f1abe None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:06.943228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d2fe41de-9a25-41f6-aece-4bc1857f1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:06.950223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 725/1449] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:06.987604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a04a-5da0-4d39-bd09-51446cca09e6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:06.998020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93a04a-5da0-4d39-bd09-51446cca09e6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:07.001323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716a65b-cd45-45a1-a61d-b76cf1e7fe71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:07.001889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a65b-cd45-45a1-a61d-b76cf1e7fe71 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:07.002178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a65b-cd45-45a1-a61d-b76cf1e7fe71 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:07.002464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716a65b-cd45-45a1-a61d-b76cf1e7fe71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:07.011908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716a65b-cd45-45a1-a61d-b76cf1e7fe71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:07.013345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716a65b-cd45-45a1-a61d-b76cf1e7fe71 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:38:07.022825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 725/1450] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:09.210220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e96ab-0954-4b70-beb8-d0df09eaa6ef None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:09.210784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e96ab-0954-4b70-beb8-d0df09eaa6ef None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:09.210784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e96ab-0954-4b70-beb8-d0df09eaa6ef None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:09.212497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 726/1451] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:09.217752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772396d-a93a-4875-8be9-a95a5572d39a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:09.218177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772396d-a93a-4875-8be9-a95a5572d39a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:09.218329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772396d-a93a-4875-8be9-a95a5572d39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:09.241989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b772396d-a93a-4875-8be9-a95a5572d39a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:09.243139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b772396d-a93a-4875-8be9-a95a5572d39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:09.250183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 726/1452] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:09.288925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e96ab-0954-4b70-beb8-d0df09eaa6ef None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:09.299206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e96ab-0954-4b70-beb8-d0df09eaa6ef None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:09.303382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092edf8-cea9-4ddf-b10e-20b0caa3f296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:09.303975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092edf8-cea9-4ddf-b10e-20b0caa3f296 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:09.304532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092edf8-cea9-4ddf-b10e-20b0caa3f296 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:09.304818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092edf8-cea9-4ddf-b10e-20b0caa3f296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:09.313359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092edf8-cea9-4ddf-b10e-20b0caa3f296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:09.314775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092edf8-cea9-4ddf-b10e-20b0caa3f296 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:38:09.324084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 727/1453] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:11.579177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0112a4-b06a-4124-bfc5-ef1088f18767 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:11.579736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0112a4-b06a-4124-bfc5-ef1088f18767 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:11.579736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0112a4-b06a-4124-bfc5-ef1088f18767 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:11.581710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 727/1454] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:38:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:11.586825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d884b-47d9-4bf1-b0f0-271444c00cab None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:11.587249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d884b-47d9-4bf1-b0f0-271444c00cab None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:11.587415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d884b-47d9-4bf1-b0f0-271444c00cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:11.609774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-aa4d884b-47d9-4bf1-b0f0-271444c00cab None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:11.610925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-aa4d884b-47d9-4bf1-b0f0-271444c00cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:11.618639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 728/1455] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:11.658315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0112a4-b06a-4124-bfc5-ef1088f18767 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:11.669369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0112a4-b06a-4124-bfc5-ef1088f18767 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:11.672722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a0361-282c-42de-a6ca-70791c2d2c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:11.673287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0361-282c-42de-a6ca-70791c2d2c2c service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:11.673583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0361-282c-42de-a6ca-70791c2d2c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:11.673874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a0361-282c-42de-a6ca-70791c2d2c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:11.683352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0361-282c-42de-a6ca-70791c2d2c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:11.684798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a0361-282c-42de-a6ca-70791c2d2c2c service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:38:11.693643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 728/1456] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:38:14.121126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3ea6-936f-4700-8b05-6e561d7b8ef7 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:14.121710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3ea6-936f-4700-8b05-6e561d7b8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:14.121710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3ea6-936f-4700-8b05-6e561d7b8ef7 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:14.123374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 729/1457] 10.222.0.23 () {54 vars in 926 bytes} [Fri Apr 8 02:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:38:14.128992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d877-c84e-4e73-b7a4-f62d7e2fc5f8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:14.129414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d877-c84e-4e73-b7a4-f62d7e2fc5f8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:14.129570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918d877-c84e-4e73-b7a4-f62d7e2fc5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:14.153229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d918d877-c84e-4e73-b7a4-f62d7e2fc5f8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:38:14.154387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d918d877-c84e-4e73-b7a4-f62d7e2fc5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:38:14.162262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 729/1458] 10.222.0.23 () {58 vars in 1023 bytes} [Fri Apr 8 02:38:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:38:14.200564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c3ea6-936f-4700-8b05-6e561d7b8ef7 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:38:14.211874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c3ea6-936f-4700-8b05-6e561d7b8ef7 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:38:14.215314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7913a7-8345-4e51-acef-8277970cb4cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:38:14.215881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7913a7-8345-4e51-acef-8277970cb4cd service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:38:14.216204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7913a7-8345-4e51-acef-8277970cb4cd service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:38:14.216494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7913a7-8345-4e51-acef-8277970cb4cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:38:14.226028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7913a7-8345-4e51-acef-8277970cb4cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:38:14.227455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7913a7-8345-4e51-acef-8277970cb4cd service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:38:14.236763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 730/1459] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:38:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:46.971434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6781ce-8506-4433-a6d9-c74d4f35f838 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:46.972087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6781ce-8506-4433-a6d9-c74d4f35f838 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:46.972087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6781ce-8506-4433-a6d9-c74d4f35f838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:46.994763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3a6781ce-8506-4433-a6d9-c74d4f35f838 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:46.995909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3a6781ce-8506-4433-a6d9-c74d4f35f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:47.003412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 730/1460] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:39:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:47.011079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec917d-cc10-4772-9098-5de7f17c3b00 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.011550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec917d-cc10-4772-9098-5de7f17c3b00 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.011664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec917d-cc10-4772-9098-5de7f17c3b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.034137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b0ec917d-cc10-4772-9098-5de7f17c3b00 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:47.035286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b0ec917d-cc10-4772-9098-5de7f17c3b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:47.042425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 731/1461] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:47.047248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6781ce-8506-4433-a6d9-c74d4f35f838 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.056592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6781ce-8506-4433-a6d9-c74d4f35f838 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.060796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.061377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.061935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.061935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.062651 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:39:47.062956 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.064589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.076684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 731/1462] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:39:47.084261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec917d-cc10-4772-9098-5de7f17c3b00 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.093713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec917d-cc10-4772-9098-5de7f17c3b00 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.097665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.098244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.098541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.098847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.099465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.101383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.138579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 732/1463] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:39:47 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:39:47.143312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.152790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf7c2c-86bd-437b-8cb2-9674e5cd1b37 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.214176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.214778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.215075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.215363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.216023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.218703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.237396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 732/1464] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:39:47 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:39:47.241567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.251227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ad134-7c57-4477-99d3-34579c1e8ccf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.255415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.256038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.256328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.256611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.257306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.258886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.269489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 733/1465] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:39:47.272922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.282859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16862f90-9150-4f5b-a329-aa540d748643 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.287069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582f06e-8d7b-4920-b294-105487303e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.287653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582f06e-8d7b-4920-b294-105487303e50 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.287970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582f06e-8d7b-4920-b294-105487303e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.288266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582f06e-8d7b-4920-b294-105487303e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.288961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582f06e-8d7b-4920-b294-105487303e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.290558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582f06e-8d7b-4920-b294-105487303e50 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.300469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 733/1466] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:39:47.304635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.313983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae5acc-283c-413f-8421-67f8d54f52b9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.318428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.319238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.319529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.319841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] PATH_INFO: `/v3/projects/05a52542d03b4c82ae443cc533c50c8b/users/5269e34b716d490e87f1f14ca1493620/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.339222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a52542d03b4c82ae443cc533c50c8b, user_id=5269e34b716d490e87f1f14ca1493620, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.341871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.354746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 734/1467] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:39:47 2022] PUT /identity/v3/projects/05a52542d03b4c82ae443cc533c50c8b/users/5269e34b716d490e87f1f14ca1493620/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:39:47.365825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028d8ef-1115-4126-b9dd-8dceb9aaecea None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.366129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028d8ef-1115-4126-b9dd-8dceb9aaecea None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.366420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028d8ef-1115-4126-b9dd-8dceb9aaecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.401854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6028d8ef-1115-4126-b9dd-8dceb9aaecea None None] MFA Rules not processed for user `5269e34b716d490e87f1f14ca1493620`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:47.403044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6028d8ef-1115-4126-b9dd-8dceb9aaecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:47.474419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 734/1468] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:47.485584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.559942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215c8a2-1d96-4e02-8ec8-9bbafb3b345d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.565143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.565722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.566015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.566331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.574540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.576153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.584976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 735/1469] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:47 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:39:47.652124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45452ae-ef3a-403f-abf7-0febed4ee1df None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.652426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45452ae-ef3a-403f-abf7-0febed4ee1df None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.652714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45452ae-ef3a-403f-abf7-0febed4ee1df None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.654308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 735/1470] 10.222.0.23 () {52 vars in 829 bytes} [Fri Apr 8 02:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:39:47.658345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.726744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995544cd-b509-4dd9-b6f7-316e73c214bd service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:47.731041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:47.731836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.732153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.732434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] PATH_INFO: `/v3/users/5269e34b716d490e87f1f14ca1493620` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.734245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5269e34b716d490e87f1f14ca1493620)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:47.735245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:39:47.735245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:39:47.735245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:39:47.736485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:47.794063 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5269e34b716d490e87f1f14ca1493620'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:47.804941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5269e34b716d490e87f1f14ca1493620'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:47.805696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5269e34b716d490e87f1f14ca1493620'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:47.806307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5269e34b716d490e87f1f14ca1493620'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:47.822698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5269e34b716d490e87f1f14ca1493620'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:47.839464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 736/1471] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:39:47 2022] DELETE /identity/v3/users/5269e34b716d490e87f1f14ca1493620 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:39:47.844342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:47.844635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:47.844918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:47.866621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:39:47.867834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:47.931065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 736/1472] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:39:47.940983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:47.942314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:48.005651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460007b6-e255-4d3d-ad5f-8c27097111e2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:48.009037 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c596c-96e9-48fd-99f0-3fbfe25979fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:48.009610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c596c-96e9-48fd-99f0-3fbfe25979fd service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:48.009899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c596c-96e9-48fd-99f0-3fbfe25979fd service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:48.010181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c596c-96e9-48fd-99f0-3fbfe25979fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:48.019315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c596c-96e9-48fd-99f0-3fbfe25979fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:48.020760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c596c-96e9-48fd-99f0-3fbfe25979fd service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:48.029539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 737/1473] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:39:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:39:48.439687 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:39:48.441187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:39:48.453546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42324b2c-bd70-43e8-b6aa-6f8b515b6392 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:39:48.458694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:39:48.459479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:39:48.459771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:39:48.460098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] PATH_INFO: `/v3/projects/05a52542d03b4c82ae443cc533c50c8b` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:39:48.461292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a52542d03b4c82ae443cc533c50c8b)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:39:48.462296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:39:48.462296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:39:48.462296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:39:48.463485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:39:48.519489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a52542d03b4c82ae443cc533c50c8b', 'request_id': 'req-1872f0c1-4453-4d6f-beef-164d26ae9273'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:48.524567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a52542d03b4c82ae443cc533c50c8b', 'request_id': 'req-1872f0c1-4453-4d6f-beef-164d26ae9273'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:48.532744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a52542d03b4c82ae443cc533c50c8b', 'request_id': 'req-1872f0c1-4453-4d6f-beef-164d26ae9273'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:48.548605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] The token cache is being invalidate because project 05a52542d03b4c82ae443cc533c50c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:39:48.548888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:48.549590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1872f0c1-4453-4d6f-beef-164d26ae9273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:39:48.551035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 737/1474] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:39:48 2022] DELETE /identity/v3/projects/05a52542d03b4c82ae443cc533c50c8b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:41:23.048310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01310907-d3c3-4279-a108-71f7ff74a701 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:23.048904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01310907-d3c3-4279-a108-71f7ff74a701 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:23.048904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01310907-d3c3-4279-a108-71f7ff74a701 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:23.050554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 738/1475] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:23.055725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c578-f9a2-4e60-a3bf-29d0247cd721 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:23.056182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c578-f9a2-4e60-a3bf-29d0247cd721 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:23.056323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060c578-f9a2-4e60-a3bf-29d0247cd721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:23.079419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e060c578-f9a2-4e60-a3bf-29d0247cd721 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:23.080625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e060c578-f9a2-4e60-a3bf-29d0247cd721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:23.145764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 738/1476] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:23.300930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01310907-d3c3-4279-a108-71f7ff74a701 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:23.302470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-01310907-d3c3-4279-a108-71f7ff74a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:23.381706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01310907-d3c3-4279-a108-71f7ff74a701 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:23.386736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bc52a-ce14-4f36-a7d0-dd8a4910e357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:23.387316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bc52a-ce14-4f36-a7d0-dd8a4910e357 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:23.387611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bc52a-ce14-4f36-a7d0-dd8a4910e357 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:23.387901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bc52a-ce14-4f36-a7d0-dd8a4910e357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:23.396308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bc52a-ce14-4f36-a7d0-dd8a4910e357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:23.397895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bc52a-ce14-4f36-a7d0-dd8a4910e357 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:23.407465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 739/1477] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:41:23.781758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401795c-ee06-433d-939d-ff27a62c3e31 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:23.782212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401795c-ee06-433d-939d-ff27a62c3e31 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:23.782507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401795c-ee06-433d-939d-ff27a62c3e31 None None] PATH_INFO: `/v3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:23.783725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 739/1478] 10.222.0.41 () {54 vars in 925 bytes} [Fri Apr 8 02:41:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:41:23.790680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23dcb-c18c-499d-a76c-17ca89c2e78f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:23.790986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23dcb-c18c-499d-a76c-17ca89c2e78f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:23.791282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a23dcb-c18c-499d-a76c-17ca89c2e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:23.815310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-74a23dcb-c18c-499d-a76c-17ca89c2e78f None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:23.816529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-74a23dcb-c18c-499d-a76c-17ca89c2e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:23.887179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 740/1479] 10.222.0.41 () {58 vars in 1015 bytes} [Fri Apr 8 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:24.791288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90e99-7d5d-4567-ad32-67bea4185f7e None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:24.791851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90e99-7d5d-4567-ad32-67bea4185f7e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:24.791851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d90e99-7d5d-4567-ad32-67bea4185f7e None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:24.793550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 740/1480] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:24.798697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac14b0-408a-4679-9fc9-0588be73d638 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:24.799165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac14b0-408a-4679-9fc9-0588be73d638 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:24.799278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac14b0-408a-4679-9fc9-0588be73d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:24.823205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-daac14b0-408a-4679-9fc9-0588be73d638 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:24.824392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-daac14b0-408a-4679-9fc9-0588be73d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:24.832199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 741/1481] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:41:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:24.981552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90e99-7d5d-4567-ad32-67bea4185f7e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:24.995448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d90e99-7d5d-4567-ad32-67bea4185f7e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:25.001516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57b43f-e885-4d6a-a7dd-46572fd123df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:25.002084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b43f-e885-4d6a-a7dd-46572fd123df service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:25.002375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b43f-e885-4d6a-a7dd-46572fd123df service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:25.002662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b43f-e885-4d6a-a7dd-46572fd123df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:25.010443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b43f-e885-4d6a-a7dd-46572fd123df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:25.012062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b43f-e885-4d6a-a7dd-46572fd123df service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:25.022059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 741/1482] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:41:32.604737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830fbf7-a03e-4e58-bff2-8fba7ec7bd5e None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:32.605200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830fbf7-a03e-4e58-bff2-8fba7ec7bd5e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:32.605333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830fbf7-a03e-4e58-bff2-8fba7ec7bd5e None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:32.607855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 742/1483] 10.222.0.23 () {54 vars in 960 bytes} [Fri Apr 8 02:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:32.612506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101356cb-2543-4e26-82bc-6524aed0ec09 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:32.612913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101356cb-2543-4e26-82bc-6524aed0ec09 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:32.613096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101356cb-2543-4e26-82bc-6524aed0ec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:32.635479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-101356cb-2543-4e26-82bc-6524aed0ec09 None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:32.636675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-101356cb-2543-4e26-82bc-6524aed0ec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:32.644738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 742/1484] 10.222.0.23 () {58 vars in 1057 bytes} [Fri Apr 8 02:41:32 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:32.651995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830fbf7-a03e-4e58-bff2-8fba7ec7bd5e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:32.665517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830fbf7-a03e-4e58-bff2-8fba7ec7bd5e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:32.671170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2eeb2-2063-4f95-acff-3ba92902438c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:32.671735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2eeb2-2063-4f95-acff-3ba92902438c service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:32.672055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2eeb2-2063-4f95-acff-3ba92902438c service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:32.672341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2eeb2-2063-4f95-acff-3ba92902438c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:32.680472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2eeb2-2063-4f95-acff-3ba92902438c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:32.682055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2eeb2-2063-4f95-acff-3ba92902438c service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:32.691428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 743/1485] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:32 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:41:36.760517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c2ce-116c-4891-99b8-8a19648b9d25 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:36.761109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c2ce-116c-4891-99b8-8a19648b9d25 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:36.761109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746c2ce-116c-4891-99b8-8a19648b9d25 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:36.762757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:36.768167 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510910-28b5-4310-b8c7-1b6e85129344 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:36.768571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510910-28b5-4310-b8c7-1b6e85129344 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:36.768743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510910-28b5-4310-b8c7-1b6e85129344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:36.790607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f5510910-28b5-4310-b8c7-1b6e85129344 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:36.791762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f5510910-28b5-4310-b8c7-1b6e85129344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:36.798801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:41:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:36.947913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c2ce-116c-4891-99b8-8a19648b9d25 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:36.961926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746c2ce-116c-4891-99b8-8a19648b9d25 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:36.966865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3d6b3-8480-4ba5-9a82-c216427fde9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:36.967429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d6b3-8480-4ba5-9a82-c216427fde9c service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:36.967719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d6b3-8480-4ba5-9a82-c216427fde9c service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:36.968134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d6b3-8480-4ba5-9a82-c216427fde9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:36.976503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d6b3-8480-4ba5-9a82-c216427fde9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:36.978075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d6b3-8480-4ba5-9a82-c216427fde9c service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:36.988004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 744/1488] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:41:38.342344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aba7f2-c038-49ab-ac8d-89f08c184d8c None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:38.342862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aba7f2-c038-49ab-ac8d-89f08c184d8c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:38.342959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aba7f2-c038-49ab-ac8d-89f08c184d8c None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:38.344709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 8 02:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:38.349575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb474a-f652-4033-b459-3bc6a6dbcfcc None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:38.350062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb474a-f652-4033-b459-3bc6a6dbcfcc None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:38.350179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb474a-f652-4033-b459-3bc6a6dbcfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:38.372862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a0cb474a-f652-4033-b459-3bc6a6dbcfcc None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:38.374001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a0cb474a-f652-4033-b459-3bc6a6dbcfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:38.382503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 8 02:41:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:38.535882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aba7f2-c038-49ab-ac8d-89f08c184d8c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:38.550308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aba7f2-c038-49ab-ac8d-89f08c184d8c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:38.555786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dfab0-8f6e-4455-8c91-e0041068deab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:38.556512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dfab0-8f6e-4455-8c91-e0041068deab service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:38.556807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dfab0-8f6e-4455-8c91-e0041068deab service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:38.557121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dfab0-8f6e-4455-8c91-e0041068deab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:38.565898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dfab0-8f6e-4455-8c91-e0041068deab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:38.567538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dfab0-8f6e-4455-8c91-e0041068deab service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:38.576322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 746/1491] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:41:42.288604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dceb56-e85d-448f-ad58-ab7d556e5026 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:42.289225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dceb56-e85d-448f-ad58-ab7d556e5026 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:42.289225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dceb56-e85d-448f-ad58-ab7d556e5026 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:42.290893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:42.296914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa334-0b19-4166-9ba6-971606400ff6 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:42.297355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa334-0b19-4166-9ba6-971606400ff6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:42.297535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa334-0b19-4166-9ba6-971606400ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:42.320186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e13fa334-0b19-4166-9ba6-971606400ff6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:42.321341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e13fa334-0b19-4166-9ba6-971606400ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:42.328286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:41:42.365346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dceb56-e85d-448f-ad58-ab7d556e5026 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:42.366957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-10dceb56-e85d-448f-ad58-ab7d556e5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:42.432492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dceb56-e85d-448f-ad58-ab7d556e5026 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:42.438666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d5f66-cc49-4f45-99a7-a46c32c59dca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:42.439297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d5f66-cc49-4f45-99a7-a46c32c59dca service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:42.439590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d5f66-cc49-4f45-99a7-a46c32c59dca service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:42.439876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d5f66-cc49-4f45-99a7-a46c32c59dca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:42.450029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d5f66-cc49-4f45-99a7-a46c32c59dca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:42.451453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d5f66-cc49-4f45-99a7-a46c32c59dca service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:42.460885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 747/1494] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:41:44.559146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0195-64fe-4326-8bb5-eade90ac56c1 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:44.559706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0195-64fe-4326-8bb5-eade90ac56c1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:44.559706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de0195-64fe-4326-8bb5-eade90ac56c1 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:44.561463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:44.566952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352f87-bfe3-4116-85cf-9f2d7a8f531f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:44.567382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352f87-bfe3-4116-85cf-9f2d7a8f531f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:44.567532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352f87-bfe3-4116-85cf-9f2d7a8f531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:44.590289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-39352f87-bfe3-4116-85cf-9f2d7a8f531f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:44.591432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-39352f87-bfe3-4116-85cf-9f2d7a8f531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:44.599558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:41:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:44.636018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0195-64fe-4326-8bb5-eade90ac56c1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:44.637634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c7de0195-64fe-4326-8bb5-eade90ac56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:44.650589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de0195-64fe-4326-8bb5-eade90ac56c1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:44.653980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114899e-874e-4caa-9864-dc44dacd4411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:44.654535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114899e-874e-4caa-9864-dc44dacd4411 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:44.654827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114899e-874e-4caa-9864-dc44dacd4411 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:44.655115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114899e-874e-4caa-9864-dc44dacd4411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:44.664571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114899e-874e-4caa-9864-dc44dacd4411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:44.665993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114899e-874e-4caa-9864-dc44dacd4411 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:44.674927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 749/1497] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:41:48.284120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3751dc-412a-411c-acc3-b0dc5025e601 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:48.284661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3751dc-412a-411c-acc3-b0dc5025e601 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:48.284759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3751dc-412a-411c-acc3-b0dc5025e601 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:48.286364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:48.291371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1a86-1688-49a8-a8fe-1f3e91d8b3b4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:48.291832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1a86-1688-49a8-a8fe-1f3e91d8b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:48.291963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a1a86-1688-49a8-a8fe-1f3e91d8b3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:48.314493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a53a1a86-1688-49a8-a8fe-1f3e91d8b3b4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:48.315674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a53a1a86-1688-49a8-a8fe-1f3e91d8b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:48.322787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:48.380094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3751dc-412a-411c-acc3-b0dc5025e601 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:48.381703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9d3751dc-412a-411c-acc3-b0dc5025e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:48.456086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3751dc-412a-411c-acc3-b0dc5025e601 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:48.460190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd1a5-247f-48d2-88ff-8b958da80e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:48.460810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1a5-247f-48d2-88ff-8b958da80e0f service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:48.461102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1a5-247f-48d2-88ff-8b958da80e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:48.461461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1a5-247f-48d2-88ff-8b958da80e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:48.473444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fd1a5-247f-48d2-88ff-8b958da80e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:48.475188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fd1a5-247f-48d2-88ff-8b958da80e0f service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:48.485637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 750/1500] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:41:50.599359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee88c4-9f34-4fdc-9aad-afef229bc1c0 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:50.599909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee88c4-9f34-4fdc-9aad-afef229bc1c0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:50.600043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee88c4-9f34-4fdc-9aad-afef229bc1c0 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:50.601739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 751/1501] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 8 02:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:50.607019 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209a67e-524b-40d0-af36-f9c9ce1d1e63 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:50.607452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209a67e-524b-40d0-af36-f9c9ce1d1e63 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:50.607598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209a67e-524b-40d0-af36-f9c9ce1d1e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:50.630989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-2209a67e-524b-40d0-af36-f9c9ce1d1e63 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:50.632202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2209a67e-524b-40d0-af36-f9c9ce1d1e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:50.639271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 751/1502] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 8 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:50.697206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacaaa-d0a1-4f83-9da3-4f582a12d558 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:50.697504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacaaa-d0a1-4f83-9da3-4f582a12d558 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:50.697794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacaaa-d0a1-4f83-9da3-4f582a12d558 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:50.699453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 752/1503] 10.222.0.23 () {54 vars in 961 bytes} [Fri Apr 8 02:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:41:50.704487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba23f-e551-4fcf-92fb-f5cb271aac15 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:50.704788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba23f-e551-4fcf-92fb-f5cb271aac15 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:50.705080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ba23f-e551-4fcf-92fb-f5cb271aac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:50.726983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d80ba23f-e551-4fcf-92fb-f5cb271aac15 None None] MFA Rules not processed for user `0e240ede71df43708e2fb859c99b0a23`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:41:50.728159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d80ba23f-e551-4fcf-92fb-f5cb271aac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:41:50.739440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 752/1504] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Apr 8 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:41:50.747981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacaaa-d0a1-4f83-9da3-4f582a12d558 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:41:50.759142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacaaa-d0a1-4f83-9da3-4f582a12d558 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:41:50.762412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d88fa-b5fe-40a6-946a-93d06413de86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:41:50.762970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d88fa-b5fe-40a6-946a-93d06413de86 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:41:50.763264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d88fa-b5fe-40a6-946a-93d06413de86 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:41:50.763545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d88fa-b5fe-40a6-946a-93d06413de86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:41:50.772189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d88fa-b5fe-40a6-946a-93d06413de86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:41:50.773597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d88fa-b5fe-40a6-946a-93d06413de86 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:41:50.782869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 753/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:41:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:41.593209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47bf1-716e-4b01-8ec9-9f7828d2e9e3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:41.595037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47bf1-716e-4b01-8ec9-9f7828d2e9e3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:41.595646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f47bf1-716e-4b01-8ec9-9f7828d2e9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:41.634636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-76f47bf1-716e-4b01-8ec9-9f7828d2e9e3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:41.636298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-76f47bf1-716e-4b01-8ec9-9f7828d2e9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:41.655310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 753/1506] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:41.679282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732e83-e4d9-4477-91a9-5188caacb15b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:41.680133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732e83-e4d9-4477-91a9-5188caacb15b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:41.680133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8732e83-e4d9-4477-91a9-5188caacb15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:41.721101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c8732e83-e4d9-4477-91a9-5188caacb15b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:41.722556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c8732e83-e4d9-4477-91a9-5188caacb15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:41.731032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 754/1507] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:41.736975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47bf1-716e-4b01-8ec9-9f7828d2e9e3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:41.756631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f47bf1-716e-4b01-8ec9-9f7828d2e9e3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:41.769773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313cf87-2acb-4778-92ad-866403218f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:41.770799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313cf87-2acb-4778-92ad-866403218f11 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:41.771300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313cf87-2acb-4778-92ad-866403218f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:41.771808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313cf87-2acb-4778-92ad-866403218f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:41.772772 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313cf87-2acb-4778-92ad-866403218f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:41.773302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313cf87-2acb-4778-92ad-866403218f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:41.775195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313cf87-2acb-4778-92ad-866403218f11 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:41.804347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 754/1508] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:41.815007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732e83-e4d9-4477-91a9-5188caacb15b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:41.828010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7da99-cbc5-4e0e-b7b1-5e92349d8d0d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:41.828010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7da99-cbc5-4e0e-b7b1-5e92349d8d0d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:41.828010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7da99-cbc5-4e0e-b7b1-5e92349d8d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:41.834517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8732e83-e4d9-4477-91a9-5188caacb15b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:41.856673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:41.857717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:41.858233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:41.858767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:41.860797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:41.863438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:41.876859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7fc7da99-cbc5-4e0e-b7b1-5e92349d8d0d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:41.879080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7fc7da99-cbc5-4e0e-b7b1-5e92349d8d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:41.903968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 755/1509] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:43:41.924870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d98ee6-7f6f-4062-a4b3-373194d57ceb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:41.925191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d98ee6-7f6f-4062-a4b3-373194d57ceb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:41.925491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d98ee6-7f6f-4062-a4b3-373194d57ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:41.929753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 755/1510] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:41 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:41.950232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:41.977176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b9d98ee6-7f6f-4062-a4b3-373194d57ceb None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:41.978377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b9d98ee6-7f6f-4062-a4b3-373194d57ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.087204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06c00f-5a4f-41d3-a01b-30e3c7bcc547 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.091954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 756/1511] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.093635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551513e5-21fe-46db-80ec-ba247b8c27ab None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.094690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551513e5-21fe-46db-80ec-ba247b8c27ab None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.096755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551513e5-21fe-46db-80ec-ba247b8c27ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.107007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f74b-585b-4985-b2ee-6f17181f9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.108195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f74b-585b-4985-b2ee-6f17181f9b59 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.108670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f74b-585b-4985-b2ee-6f17181f9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.109122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f74b-585b-4985-b2ee-6f17181f9b59 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.110164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f74b-585b-4985-b2ee-6f17181f9b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.112295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f74b-585b-4985-b2ee-6f17181f9b59 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.126595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-551513e5-21fe-46db-80ec-ba247b8c27ab None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.127920 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-551513e5-21fe-46db-80ec-ba247b8c27ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.138556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 757/1512] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.143826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeedf27-24bb-4bf5-af54-e2885cc87ba8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.144195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeedf27-24bb-4bf5-af54-e2885cc87ba8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.144552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeedf27-24bb-4bf5-af54-e2885cc87ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.157013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 756/1513] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:41 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:43:42.158922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bb50a-1ca1-4b1c-b859-5f728ae137ac None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.161433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bb50a-1ca1-4b1c-b859-5f728ae137ac None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.166963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bb50a-1ca1-4b1c-b859-5f728ae137ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.184889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4aeedf27-24bb-4bf5-af54-e2885cc87ba8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.186106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4aeedf27-24bb-4bf5-af54-e2885cc87ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.191489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-735bb50a-1ca1-4b1c-b859-5f728ae137ac None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.192838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-735bb50a-1ca1-4b1c-b859-5f728ae137ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.197940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 758/1514] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.200777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeedf27-24bb-4bf5-af54-e2885cc87ba8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.208438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 757/1515] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.208438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec5cbf-e0b9-4eeb-9f72-5fd012a3e163 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.208438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec5cbf-e0b9-4eeb-9f72-5fd012a3e163 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.208438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec5cbf-e0b9-4eeb-9f72-5fd012a3e163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.216313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeedf27-24bb-4bf5-af54-e2885cc87ba8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.221797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706d9f9-94da-40bd-8e9a-bf41cf82ea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.222403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706d9f9-94da-40bd-8e9a-bf41cf82ea92 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.222695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706d9f9-94da-40bd-8e9a-bf41cf82ea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.222993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706d9f9-94da-40bd-8e9a-bf41cf82ea92 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.223691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706d9f9-94da-40bd-8e9a-bf41cf82ea92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:42.224028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706d9f9-94da-40bd-8e9a-bf41cf82ea92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.225633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706d9f9-94da-40bd-8e9a-bf41cf82ea92 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.235917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9cec5cbf-e0b9-4eeb-9f72-5fd012a3e163 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.237233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9cec5cbf-e0b9-4eeb-9f72-5fd012a3e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.250268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 759/1516] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:42.250268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cfc47-ed6c-46f2-89fc-09582bdfd45a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.250268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cfc47-ed6c-46f2-89fc-09582bdfd45a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.250268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cfc47-ed6c-46f2-89fc-09582bdfd45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.256869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 758/1517] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.258202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfeb97-c3e4-4ce1-94b0-1d652d4ab13e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.258502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfeb97-c3e4-4ce1-94b0-1d652d4ab13e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.258789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfeb97-c3e4-4ce1-94b0-1d652d4ab13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.266999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b81cfc47-ed6c-46f2-89fc-09582bdfd45a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.268182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b81cfc47-ed6c-46f2-89fc-09582bdfd45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.280955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 760/1518] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.282312 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-57bfeb97-c3e4-4ce1-94b0-1d652d4ab13e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.282984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cfc47-ed6c-46f2-89fc-09582bdfd45a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.283536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-57bfeb97-c3e4-4ce1-94b0-1d652d4ab13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.291941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 759/1519] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.292303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cfc47-ed6c-46f2-89fc-09582bdfd45a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.293322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7128459-9278-46ad-ac2a-f2d9d544592e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.293705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7128459-9278-46ad-ac2a-f2d9d544592e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.293989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7128459-9278-46ad-ac2a-f2d9d544592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.296949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08728c-d56b-4f24-b649-8914c0f9e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.297550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08728c-d56b-4f24-b649-8914c0f9e81f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.297846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08728c-d56b-4f24-b649-8914c0f9e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.298132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08728c-d56b-4f24-b649-8914c0f9e81f admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.298836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08728c-d56b-4f24-b649-8914c0f9e81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.300544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08728c-d56b-4f24-b649-8914c0f9e81f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.311347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 761/1520] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:42.312711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490f5e6-2027-4ce9-b23f-dbe18901af5a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.313287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490f5e6-2027-4ce9-b23f-dbe18901af5a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.313287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490f5e6-2027-4ce9-b23f-dbe18901af5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.322282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e7128459-9278-46ad-ac2a-f2d9d544592e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.323467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e7128459-9278-46ad-ac2a-f2d9d544592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.331982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 760/1521] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.333240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29ce0-1ac7-4fd8-8070-1e2c984c2caf None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.333536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29ce0-1ac7-4fd8-8070-1e2c984c2caf None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.333819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29ce0-1ac7-4fd8-8070-1e2c984c2caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.339530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8490f5e6-2027-4ce9-b23f-dbe18901af5a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.340670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8490f5e6-2027-4ce9-b23f-dbe18901af5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.348712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 762/1522] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.348712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490f5e6-2027-4ce9-b23f-dbe18901af5a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.357896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b7e29ce0-1ac7-4fd8-8070-1e2c984c2caf None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.358185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490f5e6-2027-4ce9-b23f-dbe18901af5a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.359033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b7e29ce0-1ac7-4fd8-8070-1e2c984c2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.362695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aedf6f-ec76-4398-9317-6ca190c0d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.363271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aedf6f-ec76-4398-9317-6ca190c0d8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.363568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aedf6f-ec76-4398-9317-6ca190c0d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.363858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aedf6f-ec76-4398-9317-6ca190c0d8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.364519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aedf6f-ec76-4398-9317-6ca190c0d8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.366413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aedf6f-ec76-4398-9317-6ca190c0d8b8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.366806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 761/1523] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.367625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29ce0-1ac7-4fd8-8070-1e2c984c2caf None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.385642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29ce0-1ac7-4fd8-8070-1e2c984c2caf None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.391650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad2f83-5966-4abd-ab64-b3b6f8a29716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.395594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2f83-5966-4abd-ab64-b3b6f8a29716 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.395594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2f83-5966-4abd-ab64-b3b6f8a29716 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.395594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad2f83-5966-4abd-ab64-b3b6f8a29716 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.395594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad2f83-5966-4abd-ab64-b3b6f8a29716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:42.395594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad2f83-5966-4abd-ab64-b3b6f8a29716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.395594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcad2f83-5966-4abd-ab64-b3b6f8a29716 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.396686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 763/1524] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:42.397835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5c748-49fe-4bb9-a05b-0c722e77b533 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.398137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5c748-49fe-4bb9-a05b-0c722e77b533 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.398428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5c748-49fe-4bb9-a05b-0c722e77b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.408861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 762/1525] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:42.410132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc319-0fcb-4a59-8779-eb136296b07d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.410435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc319-0fcb-4a59-8779-eb136296b07d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.410722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cc319-0fcb-4a59-8779-eb136296b07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.420582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-cee5c748-49fe-4bb9-a05b-0c722e77b533 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.421955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-cee5c748-49fe-4bb9-a05b-0c722e77b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.433819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-711cc319-0fcb-4a59-8779-eb136296b07d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.434762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-711cc319-0fcb-4a59-8779-eb136296b07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.496925 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 764/1526] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.497938 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5c748-49fe-4bb9-a05b-0c722e77b533 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.507728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5c748-49fe-4bb9-a05b-0c722e77b533 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.508997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 763/1527] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.510129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cc319-0fcb-4a59-8779-eb136296b07d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.516881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.517589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.517885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.518175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.518887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.520175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cc319-0fcb-4a59-8779-eb136296b07d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.520531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.524454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee10b3-e177-400b-a52e-d303169426e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.525042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee10b3-e177-400b-a52e-d303169426e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.525335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee10b3-e177-400b-a52e-d303169426e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.525623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee10b3-e177-400b-a52e-d303169426e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.526316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee10b3-e177-400b-a52e-d303169426e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:42.526623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee10b3-e177-400b-a52e-d303169426e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.528234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee10b3-e177-400b-a52e-d303169426e7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.531263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 765/1528] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:42.532787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.542055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 764/1529] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:42.542262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb323c-5629-4762-87e7-3a1009991a6f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.543358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dca06-7709-486c-9cbb-b8c5f19384f2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.543721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dca06-7709-486c-9cbb-b8c5f19384f2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.543978 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dca06-7709-486c-9cbb-b8c5f19384f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.551851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.552491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.552789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.553339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.554068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:42.554377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.556062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.566945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-d71dca06-7709-486c-9cbb-b8c5f19384f2 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:42.568146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d71dca06-7709-486c-9cbb-b8c5f19384f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:42.568792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 766/1530] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:42.569668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.576164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 765/1531] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:42.576884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dca06-7709-486c-9cbb-b8c5f19384f2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.579953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8de5-3e9f-45ba-ab33-b5e47038eb8b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.584423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.585018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.585318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.585610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.586124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dca06-7709-486c-9cbb-b8c5f19384f2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.586249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.588207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.590679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.591195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.591483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.591764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.592420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.594958 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.608799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 767/1532] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:42.609739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.618948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2304c2-1007-41bc-991b-7659f595b1ba admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.623407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.624019 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.624318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.624632 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.625983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:42.626297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.627602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 766/1533] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:42.628542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.631144 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.652061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 768/1534] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:42.652061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.655628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b686-b6b6-4e5a-8359-e84ba5813f5d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.695668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122acbe9-53a1-4ed2-a37c-3b7752f54aed admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.700238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.700837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.701136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.701425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.702125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:42.702433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.704152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.715910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 767/1535] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:42.716714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.717900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.719244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.719711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.720107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] PATH_INFO: `/v3/projects/a7827966303d4944b40900c83b7d40b9/users/f6ebb03a3a3f4e8cbc996251a4fefb8e/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.729005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61bb7-9b27-481a-ba08-6e9ad371d36c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.733501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.734085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.734466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.734760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.735400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.737325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.739353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7827966303d4944b40900c83b7d40b9, user_id=f6ebb03a3a3f4e8cbc996251a4fefb8e, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.741997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.760021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 769/1536] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:42 2022] PUT /identity/v3/projects/a7827966303d4944b40900c83b7d40b9/users/f6ebb03a3a3f4e8cbc996251a4fefb8e/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:42.760932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.768199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 768/1537] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:42.768883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.830841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72e86c-d7f4-4607-b481-a091077a67e4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.840305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8df15-afdf-491b-ba77-26346fee50a5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.844811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.845340 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.845629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.845914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.846602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:43:42.846905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.848530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.861703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 769/1538] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:43:42.869032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.878607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b7c85-f634-4173-b1e7-5bff31a66c6f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.882852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.883431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.883716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.884023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.884710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.886300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.893750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.894361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.894660 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.894952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.895601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.896942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 770/1539] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:42.897561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.897695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.906696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbf93-7efc-4b25-9039-58739710683c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.911249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:42.911949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:42.912275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:42.912593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:42.913233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:42.915156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:42.924048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 770/1540] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:42.926976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.939065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 771/1541] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/users => generated 279 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:42.939065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:42.948031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e5845-f0ab-4e7e-9be8-daaaab86cd60 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:42.996986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c721e-0ee9-42fb-ba7b-2c5a4b93ca46 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.005462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b4cac-86f0-4957-8a7d-e51819c40d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.006277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b4cac-86f0-4957-8a7d-e51819c40d4b admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.006579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b4cac-86f0-4957-8a7d-e51819c40d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.006866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b4cac-86f0-4957-8a7d-e51819c40d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.007511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b4cac-86f0-4957-8a7d-e51819c40d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.009457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b4cac-86f0-4957-8a7d-e51819c40d4b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.010958 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.011636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.012035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.012399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.013109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.015061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.036817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 771/1542] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.037862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c9ac-1d05-4e73-9fec-30c310455793 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.038156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c9ac-1d05-4e73-9fec-30c310455793 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.038442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c9ac-1d05-4e73-9fec-30c310455793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.044378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 772/1543] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:42 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.045183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.060684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5e74c9ac-1d05-4e73-9fec-30c310455793 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:43.061867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5e74c9ac-1d05-4e73-9fec-30c310455793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:43.114319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5094-3d52-47b5-ba19-16413402fac1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.118657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.119265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.119560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.119845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.120580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.122491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.128436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 772/1544] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:43.129339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74c9ac-1d05-4e73-9fec-30c310455793 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.139333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74c9ac-1d05-4e73-9fec-30c310455793 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.144449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.148131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 773/1545] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.148266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.148266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.148266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.148559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.148670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.148670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.158000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3366d80-cd60-490e-a10a-30cddcb3af96 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.162427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.163014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.163306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.163592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.164322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.165919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.179133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 773/1546] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.179397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 774/1547] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.179491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.179569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.188953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d5588-fb94-49ee-82f4-446b6a946e59 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.248102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8d052-4730-4393-b108-e1933c659a1b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.252782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.252943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.253388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.253521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.253685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.253810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.253991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.254116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.254616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.254733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.256281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.256585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.266363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 775/1548] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.267153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.277025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433cab3-d90b-4871-814d-96c694984246 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.282345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.282948 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.283290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.283471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 774/1549] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.283622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.284257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.284444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.286236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.294145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440624b8-43a4-4006-b027-28030c909952 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.300044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.300685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.300958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.301249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.301890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.304110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.309906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 776/1550] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.309906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.323533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 775/1551] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.324841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.334408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047dd21-bce0-41a8-ad72-1a6fc50aae82 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.339005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.339615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.339905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.340227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.340928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.342707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.354074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 776/1552] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.354846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.365320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4760aba-c11d-4251-8e36-183b43dd1cba admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.369573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.370144 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.370433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.370720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.371346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.372697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851761-c0d1-4fdc-ad6c-f2789f34aed6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.373283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.376787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.377449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.377803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.378153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.387372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.388894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.395396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 777/1553] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:43.396150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.401174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 777/1554] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:43.402683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.410061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc0269-190f-4508-a9fd-846dc1def229 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.414957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.415847 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.416170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.416457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] PATH_INFO: `/v3/projects/ee869d0592334c418ed6cf2b4ba04ace/users/44a64fb1ebd9411eb6156c8ef97c3072/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.419054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3fd19-b377-4525-9690-749c62be1808 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.427176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.428896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.429415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.429937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.431385 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.434726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.439233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee869d0592334c418ed6cf2b4ba04ace, user_id=44a64fb1ebd9411eb6156c8ef97c3072, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.441436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.456626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 778/1555] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.459997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 778/1556] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:43 2022] PUT /identity/v3/projects/ee869d0592334c418ed6cf2b4ba04ace/users/44a64fb1ebd9411eb6156c8ef97c3072/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:43.460551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.461099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.481164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ef34-cf73-436f-8cb5-afaf2a41cf0f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.531990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897686b2-d622-4f25-8fbe-2a231b14e3fd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.537243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.537902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.538193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.538480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.539194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.541035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.553154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 779/1557] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.553840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.569076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161878a1-d930-44ed-bbf2-499cc6ec8f18 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.573881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.574490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.574788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.575075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.576409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.579103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.595735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 780/1558] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.595735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.603909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d55e-aa56-499f-b1b3-b2f4b5a10456 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.607817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.608838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.609627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.610490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.610713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.610897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.611123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.611123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.611562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.612111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.613203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.614398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.625029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 781/1559] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.625971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.634218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 779/1560] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.635593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.638931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03376fb7-cc24-4de1-8fd8-66ee14030a47 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.644293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f45e-eab0-4ef5-a587-de9c0c99e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.644896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f45e-eab0-4ef5-a587-de9c0c99e161 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.645190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f45e-eab0-4ef5-a587-de9c0c99e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.645479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f45e-eab0-4ef5-a587-de9c0c99e161 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.646323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619f45e-eab0-4ef5-a587-de9c0c99e161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.647787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619f45e-eab0-4ef5-a587-de9c0c99e161 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.649515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65960-b376-461d-8df2-da9c2a4f4c87 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.655368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.657049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.657579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.658007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] PATH_INFO: `/v3/projects/709f1520eee148e3911e56f61e41b2da/users/018d84b39d064bed8d7a16b1d4ecbf34/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.659504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 782/1561] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.663718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dee11-f9ad-4c68-9916-c00335d5a7c7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.664042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dee11-f9ad-4c68-9916-c00335d5a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.664337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dee11-f9ad-4c68-9916-c00335d5a7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.685541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709f1520eee148e3911e56f61e41b2da, user_id=018d84b39d064bed8d7a16b1d4ecbf34, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.686862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-063dee11-f9ad-4c68-9916-c00335d5a7c7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:43.688170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-063dee11-f9ad-4c68-9916-c00335d5a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:43.689395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.696121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 783/1562] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:43.697138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dee11-f9ad-4c68-9916-c00335d5a7c7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.709283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dee11-f9ad-4c68-9916-c00335d5a7c7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.718217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 780/1563] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:43 2022] PUT /identity/v3/projects/709f1520eee148e3911e56f61e41b2da/users/018d84b39d064bed8d7a16b1d4ecbf34/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:43.718217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.796123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.797272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.797589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.797868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.798639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.800274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.802771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f94e12-b45f-435d-8c66-f986d28cc567 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.808561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.809163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.809453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.809735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.810440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.812057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.812793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 784/1564] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.813690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.828566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 781/1565] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.828566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.828813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9714f-ec9d-4583-b7cb-85176696755c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.833409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.834240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.834534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.834822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] PATH_INFO: `/v3/projects/1d5dcc5280b74e419f99b37e90e22985/users/9adfa17e03884760ac74757f74bc46f8/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.836807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc296c-0a85-41fe-ab3c-b4b13d75c0f3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.841182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.841769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.842056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.842344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.843036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.845328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.855632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 782/1566] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.856467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.860052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5dcc5280b74e419f99b37e90e22985, user_id=9adfa17e03884760ac74757f74bc46f8, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.863033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.869133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b5613-66b5-41b2-8550-93a1b8e243cf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.875588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f6d95-7339-47b5-a3cc-6a919ddd1b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.877260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f6d95-7339-47b5-a3cc-6a919ddd1b23 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.877565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f6d95-7339-47b5-a3cc-6a919ddd1b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.877844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f6d95-7339-47b5-a3cc-6a919ddd1b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.878610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f6d95-7339-47b5-a3cc-6a919ddd1b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:43.880438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 785/1567] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:43 2022] PUT /identity/v3/projects/1d5dcc5280b74e419f99b37e90e22985/users/9adfa17e03884760ac74757f74bc46f8/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:43.880731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f6d95-7339-47b5-a3cc-6a919ddd1b23 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:43.881429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:43.896583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 783/1568] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:43.896583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ae669-b850-4d4e-99a8-030b4aa29d50 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.896583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ae669-b850-4d4e-99a8-030b4aa29d50 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.896583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ae669-b850-4d4e-99a8-030b4aa29d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:43.935046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bd1ae669-b850-4d4e-99a8-030b4aa29d50 None None] MFA Rules not processed for user `018d84b39d064bed8d7a16b1d4ecbf34`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:43.936919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bd1ae669-b850-4d4e-99a8-030b4aa29d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:43.979047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a538e-a801-410b-af94-8a95fd4728da admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:43.985744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:43.985920 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:43.986130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:43.986376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.036904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 784/1569] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:43 2022] POST /identity/v3/auth/tokens => generated 3664 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:44.036904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ae669-b850-4d4e-99a8-030b4aa29d50 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:44.079810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.081862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.092802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 786/1570] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:43 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:44.097574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:44.113056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c08b8-1237-42a3-8482-aa0faedabb1c service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:44.119741 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae27e1-5292-43df-bf38-667bc20c5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:44.120224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ae669-b850-4d4e-99a8-030b4aa29d50 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:44.122049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae27e1-5292-43df-bf38-667bc20c5695 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.122621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae27e1-5292-43df-bf38-667bc20c5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.123116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae27e1-5292-43df-bf38-667bc20c5695 admin admin] PATH_INFO: `/v3/projects/16870ad51e0f4d1d9d73d3922e34a632/users/008fc39c532a4a0ca8fc83e0d244a370/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.125004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:44.125990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.126317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.126485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] PATH_INFO: `/v3/projects/dbcdb0d9743a4f588b76486ddf7caf7c/users/74406ac58ffd4992a9b0f52bec29f4f4/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.153502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcdb0d9743a4f588b76486ddf7caf7c, user_id=74406ac58ffd4992a9b0f52bec29f4f4, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.155905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae27e1-5292-43df-bf38-667bc20c5695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16870ad51e0f4d1d9d73d3922e34a632, user_id=008fc39c532a4a0ca8fc83e0d244a370, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.157042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.162223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae27e1-5292-43df-bf38-667bc20c5695 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.177320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 785/1571] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:44 2022] PUT /identity/v3/projects/dbcdb0d9743a4f588b76486ddf7caf7c/users/74406ac58ffd4992a9b0f52bec29f4f4/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:44.178203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:44.179625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 787/1572] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:44 2022] PUT /identity/v3/projects/16870ad51e0f4d1d9d73d3922e34a632/users/008fc39c532a4a0ca8fc83e0d244a370/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:44.181082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d073-3764-4e79-9506-669ba3b25143 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.181416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d073-3764-4e79-9506-669ba3b25143 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.182398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d073-3764-4e79-9506-669ba3b25143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.229919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d648d073-3764-4e79-9506-669ba3b25143 None None] MFA Rules not processed for user `9adfa17e03884760ac74757f74bc46f8`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:44.231345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d648d073-3764-4e79-9506-669ba3b25143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:44.278480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec5af-534e-4148-8bc6-73aeaffa58e3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:44.356200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 788/1573] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:44.357447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648d073-3764-4e79-9506-669ba3b25143 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:44.384518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:44.385376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.385671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.385963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] PATH_INFO: `/v3/projects/688b5f689e3e41249484667a939fd5f8/users/e8e3c70e491a4f0691f753c8e2b95e95/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.416142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688b5f689e3e41249484667a939fd5f8, user_id=e8e3c70e491a4f0691f753c8e2b95e95, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.420969 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.463463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 786/1574] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:44 2022] PUT /identity/v3/projects/688b5f689e3e41249484667a939fd5f8/users/e8e3c70e491a4f0691f753c8e2b95e95/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:44.465849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:44.489469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648d073-3764-4e79-9506-669ba3b25143 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:44.602475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfbb1a-01f7-4884-ab40-f9cf2235501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:44.603646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfbb1a-01f7-4884-ab40-f9cf2235501c admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.604127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfbb1a-01f7-4884-ab40-f9cf2235501c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.604750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfbb1a-01f7-4884-ab40-f9cf2235501c admin admin] PATH_INFO: `/v3/projects/37dc3585b0e34c919a8cb795e79f6584/users/d58f514aead04674b58326b173757f40/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.610774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9eaf-7e11-49f2-b137-1913c28d3141 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:44.616312 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9aacf-5a8a-430f-a8b5-1a836a1259d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:44.616919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9aacf-5a8a-430f-a8b5-1a836a1259d0 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.617213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9aacf-5a8a-430f-a8b5-1a836a1259d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.618520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9aacf-5a8a-430f-a8b5-1a836a1259d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.618829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9aacf-5a8a-430f-a8b5-1a836a1259d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.621445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9aacf-5a8a-430f-a8b5-1a836a1259d0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.632614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfbb1a-01f7-4884-ab40-f9cf2235501c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dc3585b0e34c919a8cb795e79f6584, user_id=d58f514aead04674b58326b173757f40, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.636079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfbb1a-01f7-4884-ab40-f9cf2235501c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.665536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 787/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/projects => generated 355 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:44.665536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a5fb-2e01-4f23-b67e-93c5dfdc21dd None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.665951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a5fb-2e01-4f23-b67e-93c5dfdc21dd None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.666310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a5fb-2e01-4f23-b67e-93c5dfdc21dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.668119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 789/1576] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:44 2022] PUT /identity/v3/projects/37dc3585b0e34c919a8cb795e79f6584/users/d58f514aead04674b58326b173757f40/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:44.670569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cc1b-b80d-4686-890d-b4fc118aff8d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.672098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cc1b-b80d-4686-890d-b4fc118aff8d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.673701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cc1b-b80d-4686-890d-b4fc118aff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.708112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1ed2a5fb-2e01-4f23-b67e-93c5dfdc21dd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:44.709794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1ed2a5fb-2e01-4f23-b67e-93c5dfdc21dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:44.719956 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-90d3cc1b-b80d-4686-890d-b4fc118aff8d None None] MFA Rules not processed for user `74406ac58ffd4992a9b0f52bec29f4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:44.721657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-90d3cc1b-b80d-4686-890d-b4fc118aff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:44.785301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 788/1577] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:44.789236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a5fb-2e01-4f23-b67e-93c5dfdc21dd None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:44.801935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a5fb-2e01-4f23-b67e-93c5dfdc21dd None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:44.807734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a5960-fe26-4e8e-8ff0-2b58a28083ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:44.808452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a5960-fe26-4e8e-8ff0-2b58a28083ed admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.808811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a5960-fe26-4e8e-8ff0-2b58a28083ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.809277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a5960-fe26-4e8e-8ff0-2b58a28083ed admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.809869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a5960-fe26-4e8e-8ff0-2b58a28083ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.812177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a5960-fe26-4e8e-8ff0-2b58a28083ed admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.822034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 790/1578] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:44.823862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea527-b689-48e0-b42b-c93b0c4418a3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.823862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea527-b689-48e0-b42b-c93b0c4418a3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.824180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eea527-b689-48e0-b42b-c93b0c4418a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.854411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 789/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:44.856077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b583f7-2497-4781-a4c3-e381248cf247 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.856472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b583f7-2497-4781-a4c3-e381248cf247 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.856771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b583f7-2497-4781-a4c3-e381248cf247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.868959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a2eea527-b689-48e0-b42b-c93b0c4418a3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:44.870550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a2eea527-b689-48e0-b42b-c93b0c4418a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:44.902217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-80b583f7-2497-4781-a4c3-e381248cf247 None None] MFA Rules not processed for user `f6ebb03a3a3f4e8cbc996251a4fefb8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:44.903447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-80b583f7-2497-4781-a4c3-e381248cf247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:44.949107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 791/1580] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:44.961638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea527-b689-48e0-b42b-c93b0c4418a3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:44.974196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eea527-b689-48e0-b42b-c93b0c4418a3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:44.979204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:44.980231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:44.980633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:44.981026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:44.981799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:44.984222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:44.999413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 790/1581] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:45.001307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d7a2-5877-4e18-94db-b0f693adfd9e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.001766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d7a2-5877-4e18-94db-b0f693adfd9e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.002206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d7a2-5877-4e18-94db-b0f693adfd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.024701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 792/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/users => generated 284 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:45.025633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.045035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f4b8d7a2-5877-4e18-94db-b0f693adfd9e None None] MFA Rules not processed for user `d58f514aead04674b58326b173757f40`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:45.046513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f4b8d7a2-5877-4e18-94db-b0f693adfd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:45.104710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5604dce-024d-43b7-ac78-c552c39d3203 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.108955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.110189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.110539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.110943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.121964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.123773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.146588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 791/1583] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:45.146588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dab8c-ffb9-431f-8c40-70b7a66126a4 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.146588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dab8c-ffb9-431f-8c40-70b7a66126a4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.146982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 793/1584] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:45.147070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dab8c-ffb9-431f-8c40-70b7a66126a4 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.147181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.147802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 792/1585] 10.222.0.23 () {54 vars in 959 bytes} [Fri Apr 8 02:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:43:45.148644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dab8c-ffb9-431f-8c40-70b7a66126a4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.157423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302c800-7654-4587-9388-071f0f8f5b4d service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.163197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.166231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.166545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.167402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.167660 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.172559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.174330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dab8c-ffb9-431f-8c40-70b7a66126a4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.179200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99223da4-3618-4ef1-a88c-5511ba01e82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.180194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223da4-3618-4ef1-a88c-5511ba01e82b service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.180776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223da4-3618-4ef1-a88c-5511ba01e82b service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.181490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223da4-3618-4ef1-a88c-5511ba01e82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.196354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99223da4-3618-4ef1-a88c-5511ba01e82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.199866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99223da4-3618-4ef1-a88c-5511ba01e82b service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.217032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 793/1587] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:45.218471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ada70-ee50-4de7-ab87-85c586303d0a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.219343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ada70-ee50-4de7-ab87-85c586303d0a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.219486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 794/1587] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:45 2022] POST /identity/v3/users => generated 291 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:45.219949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ada70-ee50-4de7-ab87-85c586303d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.227264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.248493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b131b-3c14-48de-b7d4-ccfdad0a1ad1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.254211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.254809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-990ada70-ee50-4de7-ab87-85c586303d0a None None] MFA Rules not processed for user `f6ebb03a3a3f4e8cbc996251a4fefb8e`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:45.254961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.255118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.255414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.256168 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.257783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.258535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-990ada70-ee50-4de7-ab87-85c586303d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:45.271120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 795/1588] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:45.273413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.275759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 794/1589] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:45 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:45.277096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e2ad5-0a47-4e7d-9ec7-cac2ff8acc9b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.277402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e2ad5-0a47-4e7d-9ec7-cac2ff8acc9b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.277776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e2ad5-0a47-4e7d-9ec7-cac2ff8acc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.309781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c629e83-b16e-4720-9f8b-5f934b19fa78 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.326449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.327068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.327367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.327658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.329060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.332845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.344873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9a0e2ad5-0a47-4e7d-9ec7-cac2ff8acc9b None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:45.348764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9a0e2ad5-0a47-4e7d-9ec7-cac2ff8acc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:45.385097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 796/1590] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:45 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:45.386167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.479999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdbd8a-d40f-412c-933c-1e8389e99e47 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.486835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.487460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.487768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.488229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.489086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.490943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.507318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 797/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:45.511751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.518475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 795/1592] 10.222.0.23 () {58 vars in 1056 bytes} [Fri Apr 8 02:43:45 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:45.522912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ee448-11c7-42f1-a540-65b8711ee816 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.523246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b224e1-d0fc-49c5-9e51-9c1eded326d2 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.524507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b224e1-d0fc-49c5-9e51-9c1eded326d2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.526109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b224e1-d0fc-49c5-9e51-9c1eded326d2 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.530009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.536599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 796/1593] 10.222.0.23 () {54 vars in 959 bytes} [Fri Apr 8 02:43:45 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:43:45.537854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.538202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.538515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] PATH_INFO: `/v3/projects/fbf7c1501c854af0ad367cde1956d5dd/users/1c33c9e7156f42b391963761487a0156/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.539507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b224e1-d0fc-49c5-9e51-9c1eded326d2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.570611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b224e1-d0fc-49c5-9e51-9c1eded326d2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.581369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.582043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.582343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.584121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.585733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.590479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.591969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf7c1501c854af0ad367cde1956d5dd, user_id=1c33c9e7156f42b391963761487a0156, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.598546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.632308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 798/1594] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:45 2022] PUT /identity/v3/projects/fbf7c1501c854af0ad367cde1956d5dd/users/1c33c9e7156f42b391963761487a0156/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:45.634035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.645069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 797/1595] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:45 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:45.645069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:45.756526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6647f0-48d9-4689-b810-63b2917d4027 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.762594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239f313-c674-45a8-bc1a-329874b3e59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.763469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239f313-c674-45a8-bc1a-329874b3e59b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.763768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239f313-c674-45a8-bc1a-329874b3e59b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.764116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239f313-c674-45a8-bc1a-329874b3e59b admin admin] PATH_INFO: `/v3/projects/baaf1e5d79dc405fbc4100c33556c2f5/users/2f2d2769701f4a3d89e2eb67efbb14a1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.789872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239f313-c674-45a8-bc1a-329874b3e59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaf1e5d79dc405fbc4100c33556c2f5, user_id=2f2d2769701f4a3d89e2eb67efbb14a1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:45.793052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239f313-c674-45a8-bc1a-329874b3e59b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:45.823968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 799/1596] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:45 2022] PUT /identity/v3/projects/baaf1e5d79dc405fbc4100c33556c2f5/users/2f2d2769701f4a3d89e2eb67efbb14a1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:45.827355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39245-f830-4e57-a3aa-60b81791cf28 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.827668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39245-f830-4e57-a3aa-60b81791cf28 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.831241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39245-f830-4e57-a3aa-60b81791cf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:45.832154 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87847a-b60d-4c21-89ef-ca934db3c02b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:45.901704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-eec39245-f830-4e57-a3aa-60b81791cf28 None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:45.903438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-eec39245-f830-4e57-a3aa-60b81791cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:45.986698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:45.987551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:45.987874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:45.988191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.083184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 800/1597] 10.222.0.23 () {58 vars in 1056 bytes} [Fri Apr 8 02:43:45 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:46.095127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39245-f830-4e57-a3aa-60b81791cf28 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.118759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.120732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.143852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 798/1598] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:45 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:46.145001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.241665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39245-f830-4e57-a3aa-60b81791cf28 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.247132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.247808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.248064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.248358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.249132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.252297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.264141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 801/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:46.265537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.279988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0f5b-a0b6-4825-b435-ccdde870885a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.287732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.288407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.288817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.289184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.290040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.291830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.305299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 802/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:46.306441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.324206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac5ac7-2b47-4d94-ae6d-be3c4feb2875 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.328867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546b222-09a9-4d58-a457-9856c69d57c3 service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.332024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.332799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.333738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.334200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.338573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.339558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.340085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.340667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.341731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.344608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.356976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 799/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:46.358287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.370136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5778f-ae41-43e4-ac5e-93a05c96ff7f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.376684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.377888 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.378517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.379048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] PATH_INFO: `/v3/projects/fbf7c1501c854af0ad367cde1956d5dd/users/1c33c9e7156f42b391963761487a0156/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.387266 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf7c1501c854af0ad367cde1956d5dd, user_id=1c33c9e7156f42b391963761487a0156, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.390362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.409993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 800/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:46 2022] PUT /identity/v3/projects/fbf7c1501c854af0ad367cde1956d5dd/users/1c33c9e7156f42b391963761487a0156/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:46.411661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.497900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.504204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.522997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570e8fc-83dc-4e7e-8e50-0c4a307307af admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.528477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5fe4e-2fd8-40c8-959a-dfd774e0038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.529433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5fe4e-2fd8-40c8-959a-dfd774e0038d admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.530253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5fe4e-2fd8-40c8-959a-dfd774e0038d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.530916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5fe4e-2fd8-40c8-959a-dfd774e0038d admin admin] PATH_INFO: `/v3/projects/baaf1e5d79dc405fbc4100c33556c2f5/users/2f2d2769701f4a3d89e2eb67efbb14a1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.534216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5fe4e-2fd8-40c8-959a-dfd774e0038d admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaf1e5d79dc405fbc4100c33556c2f5, user_id=2f2d2769701f4a3d89e2eb67efbb14a1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.535139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 803/1603] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:46 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:46.537872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5fe4e-2fd8-40c8-959a-dfd774e0038d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.548445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.565628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 801/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:46 2022] PUT /identity/v3/projects/baaf1e5d79dc405fbc4100c33556c2f5/users/2f2d2769701f4a3d89e2eb67efbb14a1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:46.567323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2e23-4883-41bd-8e8b-48d252dbde0f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.567699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2e23-4883-41bd-8e8b-48d252dbde0f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.568092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2e23-4883-41bd-8e8b-48d252dbde0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.589131 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e547d6-1fe1-4e3d-a77c-46c8809d8880 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.644818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-473a2e23-4883-41bd-8e8b-48d252dbde0f None None] MFA Rules not processed for user `1c33c9e7156f42b391963761487a0156`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:46.646160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-473a2e23-4883-41bd-8e8b-48d252dbde0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:46.772609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850854c5-21e5-4013-b0d3-3f6359fa14f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.773213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850854c5-21e5-4013-b0d3-3f6359fa14f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.773526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850854c5-21e5-4013-b0d3-3f6359fa14f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.773821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850854c5-21e5-4013-b0d3-3f6359fa14f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.774678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850854c5-21e5-4013-b0d3-3f6359fa14f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:46.776345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850854c5-21e5-4013-b0d3-3f6359fa14f2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:46.811713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 804/1605] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:46.814179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd0fbd-9d9a-4b9c-9c3a-eba49ed3a421 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.814491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd0fbd-9d9a-4b9c-9c3a-eba49ed3a421 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.814786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd0fbd-9d9a-4b9c-9c3a-eba49ed3a421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.856553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 802/1606] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:46 2022] POST /identity/v3/auth/tokens => generated 3729 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:46.856553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2e23-4883-41bd-8e8b-48d252dbde0f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:46.918688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2e23-4883-41bd-8e8b-48d252dbde0f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:46.929026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:46.932709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:46.933115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:46.933420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] PATH_INFO: `/v3/projects/6f6fb8ef382748398bdfd38f45613014/users/e2a4c18ba74147939eeedd6a74e2ff8f/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:46.952443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-74cd0fbd-9d9a-4b9c-9c3a-eba49ed3a421 None None] MFA Rules not processed for user `2f2d2769701f4a3d89e2eb67efbb14a1`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:46.954568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-74cd0fbd-9d9a-4b9c-9c3a-eba49ed3a421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:46.997604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6fb8ef382748398bdfd38f45613014, user_id=e2a4c18ba74147939eeedd6a74e2ff8f, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:47.000682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:47.039377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 803/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:46 2022] PUT /identity/v3/projects/6f6fb8ef382748398bdfd38f45613014/users/e2a4c18ba74147939eeedd6a74e2ff8f/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:47.039377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:47.183143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0412e66-7881-450a-80cc-a92a8a919e98 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:47.186784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:47.187456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.187763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.188198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.300524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:47.303715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:47.304854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 805/1608] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:46 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:47.306259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4825-21f5-42d9-a8fc-b7f3ac1665fe None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.308330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4825-21f5-42d9-a8fc-b7f3ac1665fe None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.308680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe4825-21f5-42d9-a8fc-b7f3ac1665fe None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.324007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 806/1609] 10.222.0.23 () {54 vars in 912 bytes} [Fri Apr 8 02:43:47 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:43:47.325562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0446f11-a8f0-48dc-a044-9ad160baa568 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.325967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0446f11-a8f0-48dc-a044-9ad160baa568 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.326348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0446f11-a8f0-48dc-a044-9ad160baa568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.332851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 804/1610] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:47 2022] GET /identity/v3/auth/tokens => generated 3729 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:47.335592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:47.365848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9c17-75bf-40c4-9610-6d63cb4910ec service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:47.388634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a483346-9367-45f3-acd3-691ed3e2619b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:47.391522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483346-9367-45f3-acd3-691ed3e2619b service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.391860 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483346-9367-45f3-acd3-691ed3e2619b service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.392349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483346-9367-45f3-acd3-691ed3e2619b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.393343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f0446f11-a8f0-48dc-a044-9ad160baa568 None None] MFA Rules not processed for user `e2a4c18ba74147939eeedd6a74e2ff8f`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:47.395252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f0446f11-a8f0-48dc-a044-9ad160baa568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:47.538986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 807/1611] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:47 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:47.546134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326a295-c9a1-4e23-a495-4ec7a2d64233 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.547786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326a295-c9a1-4e23-a495-4ec7a2d64233 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.548532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326a295-c9a1-4e23-a495-4ec7a2d64233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.606665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1326a295-c9a1-4e23-a495-4ec7a2d64233 None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:47.608142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1326a295-c9a1-4e23-a495-4ec7a2d64233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:47.647521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a483346-9367-45f3-acd3-691ed3e2619b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:47.652341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a483346-9367-45f3-acd3-691ed3e2619b service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:47.679769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 805/1612] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:47 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:47.681319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99383d-dbe9-40db-930f-43a786a23e43 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.681775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99383d-dbe9-40db-930f-43a786a23e43 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.682270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99383d-dbe9-40db-930f-43a786a23e43 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.684449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 806/1613] 10.222.0.23 () {54 vars in 912 bytes} [Fri Apr 8 02:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:43:47.685542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99383d-dbe9-40db-930f-43a786a23e43 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:47.780919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99383d-dbe9-40db-930f-43a786a23e43 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:47.786788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953878a-7638-4924-a2e6-4b086f9ed399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:47.787445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953878a-7638-4924-a2e6-4b086f9ed399 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.787736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953878a-7638-4924-a2e6-4b086f9ed399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.788051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953878a-7638-4924-a2e6-4b086f9ed399 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.788877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953878a-7638-4924-a2e6-4b086f9ed399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:47.791158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953878a-7638-4924-a2e6-4b086f9ed399 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:47.821380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 808/1614] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:43:47 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:47.826631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 807/1615] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:43:47 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:47.830032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d420e-b4d7-45b0-80cc-5a07c9784c5c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:47.830212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d420e-b4d7-45b0-80cc-5a07c9784c5c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:47.830498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d420e-b4d7-45b0-80cc-5a07c9784c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:47.834226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326a295-c9a1-4e23-a495-4ec7a2d64233 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:47.855980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326a295-c9a1-4e23-a495-4ec7a2d64233 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:47.882812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f84d420e-b4d7-45b0-80cc-5a07c9784c5c None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:47.886389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f84d420e-b4d7-45b0-80cc-5a07c9784c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:48.022856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.024676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.024980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.026835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.063311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 808/1616] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:43:47 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:48.064187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d420e-b4d7-45b0-80cc-5a07c9784c5c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:48.151912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d420e-b4d7-45b0-80cc-5a07c9784c5c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:48.157719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.158393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.158681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.158962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.160141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.162542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.180262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.184810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.186597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 809/1617] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:43:48 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:43:48.188201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:48.200590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb49211-37f8-4ef8-8a28-c49fd418212e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:48.205265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.206042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.206336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.207723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.211919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 809/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:47 2022] GET /identity/v3/auth/tokens => generated 3664 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:48.213335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:48.219148 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:48.248203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.253232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.294075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 810/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:48 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:48.295392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:48.324856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4a07e-bbf1-4bd8-977b-d29ebef1a049 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:48.339968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.341577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.342630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.344918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.346062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.353262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.357657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19579531-cf67-42ed-97ea-27cae013b3b0 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:48.369995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.370976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.372126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.372126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.385141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 811/1620] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:48.392057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:48.395967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.399306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.409006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4d8f1-007c-4a76-b9fe-cca89b4be9f6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:48.430284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 810/1621] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:48 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:48.432361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.435527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.437680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.450903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] PATH_INFO: `/v3/projects/9fc25f65edd6433995fd2242536e3b43/users/b8eb8e515a1f4cc88d0b500edc8ee78b/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.523399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc25f65edd6433995fd2242536e3b43, user_id=b8eb8e515a1f4cc88d0b500edc8ee78b, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.533362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.573373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 812/1622] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:48 2022] PUT /identity/v3/projects/9fc25f65edd6433995fd2242536e3b43/users/b8eb8e515a1f4cc88d0b500edc8ee78b/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:43:48.577651 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:48.591136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0756-f244-489d-8705-8b4831bc2a7b service glance] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:48.743089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ab2fd-e130-4a33-88c8-5226128615f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.745855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab2fd-e130-4a33-88c8-5226128615f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.746315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab2fd-e130-4a33-88c8-5226128615f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.746721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab2fd-e130-4a33-88c8-5226128615f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.747572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ab2fd-e130-4a33-88c8-5226128615f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.751976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ab2fd-e130-4a33-88c8-5226128615f4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.779897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 811/1623] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:43:48.780867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:48.803412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e8a24-4722-43d8-87e3-f23f70e9daa7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:48.826651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:48.842104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.843331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.843884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] PATH_INFO: `/v3/projects/9fc25f65edd6433995fd2242536e3b43/users/b8eb8e515a1f4cc88d0b500edc8ee78b/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:48.853285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc25f65edd6433995fd2242536e3b43, user_id=b8eb8e515a1f4cc88d0b500edc8ee78b, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:48.856142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:48.905854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 813/1624] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:43:48 2022] PUT /identity/v3/projects/9fc25f65edd6433995fd2242536e3b43/users/b8eb8e515a1f4cc88d0b500edc8ee78b/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:48.916759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47d79-348b-4402-8a51-3163ac4356a2 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:48.917158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47d79-348b-4402-8a51-3163ac4356a2 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:48.917516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f47d79-348b-4402-8a51-3163ac4356a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:49.003520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d3f47d79-348b-4402-8a51-3163ac4356a2 None None] MFA Rules not processed for user `b8eb8e515a1f4cc88d0b500edc8ee78b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:49.004764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d3f47d79-348b-4402-8a51-3163ac4356a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:49.183405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 812/1625] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:48 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:49.397219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:49.452041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271cad2-efb3-4620-9dee-46251876d2bb None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:49.452589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271cad2-efb3-4620-9dee-46251876d2bb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:49.453292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271cad2-efb3-4620-9dee-46251876d2bb None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:49.456384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 813/1626] 10.222.0.23 () {54 vars in 912 bytes} [Fri Apr 8 02:43:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 08 02:43:49.465219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b826e-4b79-482c-bc3f-c06bdbbca0e4 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:49.466245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b826e-4b79-482c-bc3f-c06bdbbca0e4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:49.466987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b826e-4b79-482c-bc3f-c06bdbbca0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:49.569694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406e9af-ddfb-4a47-96b1-470182cc1270 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:49.580894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:49.581707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:49.582000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:49.582432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:49.604518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:49.607606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:49.622294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 814/1627] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:49 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:49.651731 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-234b826e-4b79-482c-bc3f-c06bdbbca0e4 None None] MFA Rules not processed for user `865abd5c9d3b454ca1011e6e3111f580`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:49.654638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-234b826e-4b79-482c-bc3f-c06bdbbca0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:49.830123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 814/1628] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:43:49 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:43:49.902406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:49.920463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0c19-72d7-402d-8ff6-fe7863ede664 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:49.931088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908483d-5579-4bfe-a95b-5586e48e349e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:49.931792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908483d-5579-4bfe-a95b-5586e48e349e service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:49.932150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908483d-5579-4bfe-a95b-5586e48e349e service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:49.932518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908483d-5579-4bfe-a95b-5586e48e349e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:49.943755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908483d-5579-4bfe-a95b-5586e48e349e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:49.945465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908483d-5579-4bfe-a95b-5586e48e349e service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:49.960011 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 815/1629] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:49 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:51.220301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d379f-0eac-46d6-859f-d7fef4c8f201 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:51.220861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d379f-0eac-46d6-859f-d7fef4c8f201 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:51.220861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d379f-0eac-46d6-859f-d7fef4c8f201 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:51.222664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 815/1630] 10.222.0.23 () {54 vars in 960 bytes} [Fri Apr 8 02:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:43:51.228551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6934-d2db-451f-b368-350a60c2da77 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:51.229194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6934-d2db-451f-b368-350a60c2da77 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:51.229194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6934-d2db-451f-b368-350a60c2da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:51.283394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-63bd6934-d2db-451f-b368-350a60c2da77 None None] MFA Rules not processed for user `9ed63325027545d1bb46f1031a736089`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:51.285878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-63bd6934-d2db-451f-b368-350a60c2da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:51.527844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 816/1631] 10.222.0.23 () {58 vars in 1057 bytes} [Fri Apr 8 02:43:51 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:43:51.530429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d379f-0eac-46d6-859f-d7fef4c8f201 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:51.545614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6934-d2db-451f-b368-350a60c2da77 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:51.546711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d379f-0eac-46d6-859f-d7fef4c8f201 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:51.560230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:51.560834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:51.561132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:51.561427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:51.580094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6934-d2db-451f-b368-350a60c2da77 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:51.597138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:51.598027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:51.598593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:51.599185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:51.601255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:51.641101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:51.645454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:51.663072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 817/1632] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:51 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:51.715013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:51.717475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:51.758151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 816/1633] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:51 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:51.997830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:52.014273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306ec96-e9b3-4046-97d9-b7519803a1ad service placement] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:52.033619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6cce0-177c-46fa-b1bc-b3b3f6472380 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:52.035452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6cce0-177c-46fa-b1bc-b3b3f6472380 service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:52.036046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6cce0-177c-46fa-b1bc-b3b3f6472380 service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:52.036352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6cce0-177c-46fa-b1bc-b3b3f6472380 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:52.039581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6ac6cce0-177c-46fa-b1bc-b3b3f6472380 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:52.061489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6cce0-177c-46fa-b1bc-b3b3f6472380 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:52.065846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6cce0-177c-46fa-b1bc-b3b3f6472380 service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:52.103670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 818/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:51 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:53.286257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:53.509665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b0c0-9ecb-4f3a-ae43-004a7a0bce70 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:53.525383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:53.526462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:53.530308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:53.531638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] PATH_INFO: `/v3/users/74406ac58ffd4992a9b0f52bec29f4f4` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:53.539613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74406ac58ffd4992a9b0f52bec29f4f4)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:53.543859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: WARNING py.warnings [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:43:53.543859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: warnings.warn(msg) Apr 08 02:43:53.543859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: Apr 08 02:43:53.547898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:53.695957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74406ac58ffd4992a9b0f52bec29f4f4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:53.697250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74406ac58ffd4992a9b0f52bec29f4f4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:53.740621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74406ac58ffd4992a9b0f52bec29f4f4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:53.743094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74406ac58ffd4992a9b0f52bec29f4f4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:53.764716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74406ac58ffd4992a9b0f52bec29f4f4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:53.795302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 817/1635] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:43:53 2022] DELETE /identity/v3/users/74406ac58ffd4992a9b0f52bec29f4f4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:53.801119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:53.801661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:53.801772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:53.863038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:53.865732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:53.972844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 819/1636] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:54.167190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:54.170085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:54.372608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aae92-16e8-4977-9dcf-dbb0dd297de5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:54.383657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a4680-b964-4ec8-a0c1-b0651c209928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:54.384362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a4680-b964-4ec8-a0c1-b0651c209928 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:54.384691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a4680-b964-4ec8-a0c1-b0651c209928 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:54.384984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a4680-b964-4ec8-a0c1-b0651c209928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:54.406965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a4680-b964-4ec8-a0c1-b0651c209928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:54.408493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a4680-b964-4ec8-a0c1-b0651c209928 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:54.445734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 818/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:54.842132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:54.844073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:54.866001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae30a0-1dc9-4f3e-b35e-a503d6a3d8b4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:54.879891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:54.881851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:54.883093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:54.884935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] PATH_INFO: `/v3/users/9adfa17e03884760ac74757f74bc46f8` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:54.889257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9adfa17e03884760ac74757f74bc46f8)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:54.892205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:55.004128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9adfa17e03884760ac74757f74bc46f8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:55.022577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9adfa17e03884760ac74757f74bc46f8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:55.024480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9adfa17e03884760ac74757f74bc46f8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:55.026654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9adfa17e03884760ac74757f74bc46f8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:55.064947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b26844fe-0f27-46e0-bc0e-ab78f512f44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9adfa17e03884760ac74757f74bc46f8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:55.096220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 820/1638] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:43:54 2022] DELETE /identity/v3/users/9adfa17e03884760ac74757f74bc46f8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:55.098080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:55.098380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:55.098671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:55.143634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:55.147235 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:55.276163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 819/1639] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:43:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:55.532303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:55.532602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:55.532945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:55.587387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:55.588600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:55.630584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:55.632696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:55.754895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 821/1640] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:43:55 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:43:55.821991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc75dd-65ed-4503-ad00-0c9ad7244a92 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:55.831466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:55.833382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:55.833690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:55.833998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:55.873071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:55.879200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:55.922948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 820/1641] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:56.053262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:56.055669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:56.285495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28990-b36c-4168-baff-4a4de38715a1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:56.300445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:56.301797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:56.303435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:56.303896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:56.331827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:56.336797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:56.355328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 822/1642] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:43:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:43:58.508251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:58.509656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:58.615040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f7fe7-4d24-4f3c-a0b9-6c867174278b service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:58.620563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:58.622092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:58.622743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:58.623388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:58.627557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:58.736923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:58.739073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:58.756226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 821/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:43:58 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:43:58.962845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:58.964868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:59.003861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d26a0-63b2-4515-87d8-c74832c90b20 service swift] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:59.021885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:59.028159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:59.029888 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:59.030458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] PATH_INFO: `/v3/projects/1d5dcc5280b74e419f99b37e90e22985` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:59.037280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5dcc5280b74e419f99b37e90e22985)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:59.040482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: WARNING py.warnings [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 08 02:43:59.040482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: warnings.warn(msg) Apr 08 02:43:59.040482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: Apr 08 02:43:59.052548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:59.275714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5dcc5280b74e419f99b37e90e22985', 'request_id': 'req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.287823 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5dcc5280b74e419f99b37e90e22985', 'request_id': 'req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.329040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5dcc5280b74e419f99b37e90e22985', 'request_id': 'req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.353105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] The token cache is being invalidate because project 1d5dcc5280b74e419f99b37e90e22985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:43:59.353408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.354294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.356087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 823/1644] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:43:58 2022] DELETE /identity/v3/projects/1d5dcc5280b74e419f99b37e90e22985 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:59.361319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:59.381998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d739f03-3201-4dd6-b590-56b15e0fbdba service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:59.480809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:43:59.482508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:59.498912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:59.500622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:59.501015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:59.501409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] PATH_INFO: `/v3/users/2f2d2769701f4a3d89e2eb67efbb14a1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:59.502863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f2d2769701f4a3d89e2eb67efbb14a1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:59.505493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:43:59.598444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2d2769701f4a3d89e2eb67efbb14a1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.600242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2d2769701f4a3d89e2eb67efbb14a1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.625415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2d2769701f4a3d89e2eb67efbb14a1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.629545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2d2769701f4a3d89e2eb67efbb14a1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.677523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b4c818e-0c6a-4961-be09-afb15cbcb122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2d2769701f4a3d89e2eb67efbb14a1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:43:59.743351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 822/1645] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:43:59 2022] DELETE /identity/v3/users/2f2d2769701f4a3d89e2eb67efbb14a1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:43:59.781910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0608d0c-601e-4687-ab44-d37cb2f0f5d3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:59.781910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0608d0c-601e-4687-ab44-d37cb2f0f5d3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:59.782143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0608d0c-601e-4687-ab44-d37cb2f0f5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:59.803681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ad34c-d40c-440e-a2ac-eab5c23eaddc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:43:59.841475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a0608d0c-601e-4687-ab44-d37cb2f0f5d3 None None] MFA Rules not processed for user `865abd5c9d3b454ca1011e6e3111f580`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:43:59.846605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a0608d0c-601e-4687-ab44-d37cb2f0f5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:43:59.980501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:43:59.981877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:43:59.982321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:43:59.982769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] PATH_INFO: `/v3/projects/dbcdb0d9743a4f588b76486ddf7caf7c` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:43:59.986361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcdb0d9743a4f588b76486ddf7caf7c)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:43:59.988529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:00.125287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcdb0d9743a4f588b76486ddf7caf7c', 'request_id': 'req-2c1740ce-e323-4689-ad28-d43316bd0317'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:00.149144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcdb0d9743a4f588b76486ddf7caf7c', 'request_id': 'req-2c1740ce-e323-4689-ad28-d43316bd0317'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:00.177155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcdb0d9743a4f588b76486ddf7caf7c', 'request_id': 'req-2c1740ce-e323-4689-ad28-d43316bd0317'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:00.192664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 823/1646] 10.222.0.41 () {58 vars in 1015 bytes} [Fri Apr 8 02:43:59 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:00.197501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] The token cache is being invalidate because project dbcdb0d9743a4f588b76486ddf7caf7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:00.198123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:00.198975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:00.203942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 824/1647] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:43:59 2022] DELETE /identity/v3/projects/dbcdb0d9743a4f588b76486ddf7caf7c => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:00.208866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233bc2-e5b8-456f-bf9f-29c0a881b6d5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:00.209785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233bc2-e5b8-456f-bf9f-29c0a881b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:00.209785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b233bc2-e5b8-456f-bf9f-29c0a881b6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:00.270563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3b233bc2-e5b8-456f-bf9f-29c0a881b6d5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:00.282189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3b233bc2-e5b8-456f-bf9f-29c0a881b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:00.324978 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:00.328166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:00.505057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 824/1648] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:00.514533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6545-6b08-424c-a399-a5d80fe262c6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:00.518257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6545-6b08-424c-a399-a5d80fe262c6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:00.518606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a6545-6b08-424c-a399-a5d80fe262c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:00.568597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e61a6545-6b08-424c-a399-a5d80fe262c6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:00.569822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e61a6545-6b08-424c-a399-a5d80fe262c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:00.614224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 825/1649] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:00.614866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1740ce-e323-4689-ad28-d43316bd0317 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:00.616614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6545-6b08-424c-a399-a5d80fe262c6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:00.629247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:00.633089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:00.634599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:00.634892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:00.638292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a6545-6b08-424c-a399-a5d80fe262c6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:00.643728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:00.651171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:00.654269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:00.654725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:00.654969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:00.657705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:00.658564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:00.661889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:00.685844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:00.690657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 826/1650] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:00.692664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:00.696706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:00.717057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776889d8-a977-4957-8a94-024ac146b414 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:00.732496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:00.733121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:00.733416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:00.734256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:00.734924 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:00.737231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:00.737571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 825/1651] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:00 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:00.812463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:00.817082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 827/1652] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:00 2022] POST /identity/v3/projects => generated 403 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:00.838361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e45b87-ada3-4547-b173-47e2fcb945f3 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:01.041725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:01.044558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:01.044859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:01.045151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:01.045813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:01.075691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:01.186497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:01.196363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 826/1653] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:00 2022] POST /identity/v3/users => generated 302 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:01.202379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a4116-0042-488c-b701-8d63c8ecac80 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:01.210225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:01.211141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:01.211791 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:01.212378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:01.214487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:01.215300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:01.234291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:01.245521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 828/1654] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:01.247944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb84bf-6146-4197-9884-718ecf3d96b5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:01.254049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbfd55-cf52-4f6a-b79a-6ff7ee6f6124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:01.254896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbfd55-cf52-4f6a-b79a-6ff7ee6f6124 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:01.255300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbfd55-cf52-4f6a-b79a-6ff7ee6f6124 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:01.255687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbfd55-cf52-4f6a-b79a-6ff7ee6f6124 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:01.257721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbfd55-cf52-4f6a-b79a-6ff7ee6f6124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:01.260390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbfd55-cf52-4f6a-b79a-6ff7ee6f6124 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:01.280957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:01.295714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 827/1655] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:01.296391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086db1f-d036-4a2e-86d1-c8427677dbd3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:01.302619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:01.304490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:01.304910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:01.305459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] PATH_INFO: `/v3/projects/a7ffc9314faf4803b8cdfe78316b9baa/users/e226df214fe346ecbe79aa0a0e1932c9/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:01.330575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ffc9314faf4803b8cdfe78316b9baa, user_id=e226df214fe346ecbe79aa0a0e1932c9, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:01.333229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:01.373787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b0f42-6f80-40d5-a1b4-85a0e39fb733 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:01.375171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b0f42-6f80-40d5-a1b4-85a0e39fb733 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:01.375908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b0f42-6f80-40d5-a1b4-85a0e39fb733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:01.383284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 829/1656] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:01 2022] PUT /identity/v3/projects/a7ffc9314faf4803b8cdfe78316b9baa/users/e226df214fe346ecbe79aa0a0e1932c9/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:01.533876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-899b0f42-6f80-40d5-a1b4-85a0e39fb733 None None] MFA Rules not processed for user `e226df214fe346ecbe79aa0a0e1932c9`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:01.534998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-899b0f42-6f80-40d5-a1b4-85a0e39fb733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:01.833146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 828/1657] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:01 2022] POST /identity/v3/auth/tokens => generated 3710 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:01.834679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:02.040100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860489bd-da2d-4abb-a44c-ca5740483dd9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:02.056617 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5d12b-9d65-4400-8fe9-b5ecb7b75f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:02.057709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5d12b-9d65-4400-8fe9-b5ecb7b75f6d admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:02.057709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5d12b-9d65-4400-8fe9-b5ecb7b75f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:02.058247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5d12b-9d65-4400-8fe9-b5ecb7b75f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:02.059020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5d12b-9d65-4400-8fe9-b5ecb7b75f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:02.062152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5d12b-9d65-4400-8fe9-b5ecb7b75f6d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:02.131592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b0f42-6f80-40d5-a1b4-85a0e39fb733 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:02.132979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 830/1658] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:01 2022] POST /identity/v3/projects => generated 405 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:02.156656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b0f42-6f80-40d5-a1b4-85a0e39fb733 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:02.799774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:02.800287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:02.800788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:02.855690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:02.856402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:02.856626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:02.856915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:02.857570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:02.868354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:02.926345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] MFA Rules not processed for user `44a64fb1ebd9411eb6156c8ef97c3072`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:02.927687 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:02.950714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 829/1659] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:02 2022] POST /identity/v3/users => generated 309 bytes in 820 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:02.951836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:02.986099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a5844-ad7c-4ed4-87cd-6106c8f70ea8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:03.028719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:03.029350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:03.029650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:03.029982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:03.030859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:03.038411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:03.081816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 830/1660] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:03.082766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:03.134715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c9e38-a185-40b7-a49d-2bdf204d93c0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:03.192490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:03.201270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:03.201584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:03.201909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] PATH_INFO: `/v3/projects/3d5abea9043b4fd589d63e6e3040f5a4/users/1e62dda4f7eb44b1b5253c020e6c1af9/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:03.289701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5abea9043b4fd589d63e6e3040f5a4, user_id=1e62dda4f7eb44b1b5253c020e6c1af9, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:03.292679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:03.301267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 831/1661] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:02 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:03.316432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:03.317694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:03.345256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 831/1662] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:03 2022] PUT /identity/v3/projects/3d5abea9043b4fd589d63e6e3040f5a4/users/1e62dda4f7eb44b1b5253c020e6c1af9/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:03.348678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:03.586614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa78459-6cab-40b2-b83e-382276e6f468 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:03.601049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3013707-35f4-4bfd-8036-a9e6267eee9d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:03.611034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:03.611895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:03.618140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:03.618667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:03.619566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:03.621376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:03.681559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 832/1663] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:03.682676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:03.725895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14f51-ef4c-4457-9edc-8d58d0ee3012 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:03.748640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f22a4c-080e-482e-9bd7-2eae33a88818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:03.750028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22a4c-080e-482e-9bd7-2eae33a88818 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:03.751880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22a4c-080e-482e-9bd7-2eae33a88818 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:03.753245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f22a4c-080e-482e-9bd7-2eae33a88818 admin admin] PATH_INFO: `/v3/projects/3d5abea9043b4fd589d63e6e3040f5a4/users/1e62dda4f7eb44b1b5253c020e6c1af9/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:03.765533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f22a4c-080e-482e-9bd7-2eae33a88818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5abea9043b4fd589d63e6e3040f5a4, user_id=1e62dda4f7eb44b1b5253c020e6c1af9, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:03.768600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f22a4c-080e-482e-9bd7-2eae33a88818 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:03.817152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 833/1664] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:03 2022] PUT /identity/v3/projects/3d5abea9043b4fd589d63e6e3040f5a4/users/1e62dda4f7eb44b1b5253c020e6c1af9/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:03.838759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:03.840042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:03.840355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:03.908200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:03.908898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:03.909214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:03.909539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:03.971484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] MFA Rules not processed for user `1e62dda4f7eb44b1b5253c020e6c1af9`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:03.973257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:04.247822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:04.266675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:04.307898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 832/1665] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:03 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 992 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:04.309294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:04.313243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:04.376180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7401e-8704-43d9-8caa-03381a55b59f service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:04.397141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 834/1666] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:03 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 556 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:04.411878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:04.422337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:04.682834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:04.683962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:04.692394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:04.692832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] PATH_INFO: `/v3/users/d58f514aead04674b58326b173757f40` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:04.694650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4b165-dbea-41a6-8a80-57ff6461e140 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:04.698220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58f514aead04674b58326b173757f40)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:04.700374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:04.704456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889de65-616f-488d-b367-79a25747808e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:04.705734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889de65-616f-488d-b367-79a25747808e service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:04.707289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889de65-616f-488d-b367-79a25747808e service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:04.707605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889de65-616f-488d-b367-79a25747808e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:04.729000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889de65-616f-488d-b367-79a25747808e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:04.734662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889de65-616f-488d-b367-79a25747808e service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:04.759057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 835/1667] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:04 2022] GET /identity/v3/auth/tokens => generated 3779 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:04.895874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58f514aead04674b58326b173757f40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:04.896926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58f514aead04674b58326b173757f40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:04.924678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58f514aead04674b58326b173757f40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:04.931235 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58f514aead04674b58326b173757f40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:04.965068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58f514aead04674b58326b173757f40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:04.984881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 833/1668] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:04 2022] DELETE /identity/v3/users/d58f514aead04674b58326b173757f40 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:04.991302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:04.991719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:04.991978 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:05.005065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:05.011306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:05.045018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:05.045654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:05.228701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 836/1669] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:05.236303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:05.238275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:05.316010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f73578-e5bc-4584-8853-7b8e8db425a8 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:05.331427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:05.332985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:05.333752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:05.334355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] PATH_INFO: `/v3/users/e226df214fe346ecbe79aa0a0e1932c9` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:05.336328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e226df214fe346ecbe79aa0a0e1932c9)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:05.345379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:05.385066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670dbce-2ec7-43e6-bf3a-c92f2eb62ef3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:05.396375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648d550-db44-40a6-8328-dbc4deda44b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:05.396982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d550-db44-40a6-8328-dbc4deda44b3 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:05.397278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d550-db44-40a6-8328-dbc4deda44b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:05.397861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648d550-db44-40a6-8328-dbc4deda44b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:05.420644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648d550-db44-40a6-8328-dbc4deda44b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:05.424593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648d550-db44-40a6-8328-dbc4deda44b3 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:05.455796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 837/1670] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:05.517954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e226df214fe346ecbe79aa0a0e1932c9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:05.520207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e226df214fe346ecbe79aa0a0e1932c9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:05.550695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e226df214fe346ecbe79aa0a0e1932c9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:05.550695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e226df214fe346ecbe79aa0a0e1932c9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:05.583377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-09fac0a1-fc6e-41ce-a111-10accaed20bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e226df214fe346ecbe79aa0a0e1932c9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:05.613054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 834/1671] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:05 2022] DELETE /identity/v3/users/e226df214fe346ecbe79aa0a0e1932c9 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:05.614747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:05.615093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:05.615406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:05.681214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:05.682423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:05.927009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 838/1672] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:05.971883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:05.972206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:05.972674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:05.995852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:05.997662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:06.094941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] MFA Rules not processed for user `e8e3c70e491a4f0691f753c8e2b95e95`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:06.098695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:06.175167 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb82d16-1d12-4294-9afc-1b048d48e72a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:06.214552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:06.246659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:06.247046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:06.247346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:06.290886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:06.292415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:06.330686 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 839/1673] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:06.408268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 835/1674] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:05 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:06.421631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:06.422837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:06.720256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba68b70-100c-48e5-a73e-840d8e53bdcc service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:06.738447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9b6b3-3954-430f-b7b6-a1c3dac2aa39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:06.741676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b6b3-3954-430f-b7b6-a1c3dac2aa39 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:06.741936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b6b3-3954-430f-b7b6-a1c3dac2aa39 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:06.742254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9b6b3-3954-430f-b7b6-a1c3dac2aa39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:06.799371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9b6b3-3954-430f-b7b6-a1c3dac2aa39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:06.801051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9b6b3-3954-430f-b7b6-a1c3dac2aa39 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:06.880987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 840/1675] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:06 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:08.142548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:08.146033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:08.182674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa820ff-0a03-4b63-87e4-5552b9b10436 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:08.206291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:08.207116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:08.207654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:08.208205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] PATH_INFO: `/v3/projects/baaf1e5d79dc405fbc4100c33556c2f5` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:08.219223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baaf1e5d79dc405fbc4100c33556c2f5)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:08.237139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:08.422399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baaf1e5d79dc405fbc4100c33556c2f5', 'request_id': 'req-ff6f1b35-53fd-4ac2-92be-f2901619e605'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:08.435277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baaf1e5d79dc405fbc4100c33556c2f5', 'request_id': 'req-ff6f1b35-53fd-4ac2-92be-f2901619e605'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:08.455344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baaf1e5d79dc405fbc4100c33556c2f5', 'request_id': 'req-ff6f1b35-53fd-4ac2-92be-f2901619e605'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:08.501025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] The token cache is being invalidate because project baaf1e5d79dc405fbc4100c33556c2f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:08.501914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:08.503009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:08.506024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 836/1676] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:08 2022] DELETE /identity/v3/projects/baaf1e5d79dc405fbc4100c33556c2f5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:08.511261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80525b7-e4b4-4404-acaf-c1eabb5ddb63 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:08.511740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80525b7-e4b4-4404-acaf-c1eabb5ddb63 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:08.512150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80525b7-e4b4-4404-acaf-c1eabb5ddb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:08.620371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f80525b7-e4b4-4404-acaf-c1eabb5ddb63 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:08.621766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f80525b7-e4b4-4404-acaf-c1eabb5ddb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:08.732656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:08.737789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:08.974526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 841/1677] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:08.977215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed2c-3b6e-44d6-b00c-8edef7e88355 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:08.977539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed2c-3b6e-44d6-b00c-8edef7e88355 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:08.977851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed2c-3b6e-44d6-b00c-8edef7e88355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:08.998922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f1b35-53fd-4ac2-92be-f2901619e605 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:09.038210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:09.039045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:09.039342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:09.039678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] PATH_INFO: `/v3/projects/37dc3585b0e34c919a8cb795e79f6584` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:09.048717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dc3585b0e34c919a8cb795e79f6584)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:09.050672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:09.067245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5218ed2c-3b6e-44d6-b00c-8edef7e88355 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:09.074183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5218ed2c-3b6e-44d6-b00c-8edef7e88355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:09.110356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 842/1678] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:09.112347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ed2c-3b6e-44d6-b00c-8edef7e88355 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:09.150061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ed2c-3b6e-44d6-b00c-8edef7e88355 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:09.205443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dc3585b0e34c919a8cb795e79f6584', 'request_id': 'req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.225752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dc3585b0e34c919a8cb795e79f6584', 'request_id': 'req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.248494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dc3585b0e34c919a8cb795e79f6584', 'request_id': 'req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.292976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] The token cache is being invalidate because project 37dc3585b0e34c919a8cb795e79f6584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:09.293312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.294142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-491914d1-eb0f-4a67-ae0f-d80f2e94ee95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.299571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 837/1679] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:08 2022] DELETE /identity/v3/projects/37dc3585b0e34c919a8cb795e79f6584 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:09.301387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0e78a-1d51-468d-bab0-6340da1063a5 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:09.301757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0e78a-1d51-468d-bab0-6340da1063a5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:09.302306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0e78a-1d51-468d-bab0-6340da1063a5 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:09.305026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 838/1680] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:44:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:44:09.305809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0e78a-1d51-468d-bab0-6340da1063a5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:09.308399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-51a0e78a-1d51-468d-bab0-6340da1063a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:09.479155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:09.479844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:09.480566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:09.480881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:09.492263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:09.492611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:09.495461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:09.510152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0e78a-1d51-468d-bab0-6340da1063a5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:09.518402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:09.520180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:09.521171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:09.522579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] PATH_INFO: `/v3/users/e2a4c18ba74147939eeedd6a74e2ff8f` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:09.524614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a4c18ba74147939eeedd6a74e2ff8f)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:09.529162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:09.580398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 843/1681] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:09.580398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:09.581833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:09.642377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e1778-f2ba-4f1c-bb88-028ea4a7a1eb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:09.674221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:09.675045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:09.675701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:09.676194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] PATH_INFO: `/v3/projects/a7ffc9314faf4803b8cdfe78316b9baa` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:09.679121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ffc9314faf4803b8cdfe78316b9baa)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:09.682909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:09.701579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a4c18ba74147939eeedd6a74e2ff8f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.708263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a4c18ba74147939eeedd6a74e2ff8f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.732363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a4c18ba74147939eeedd6a74e2ff8f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.738702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a4c18ba74147939eeedd6a74e2ff8f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.753471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a4c18ba74147939eeedd6a74e2ff8f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.778426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 839/1682] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:09 2022] DELETE /identity/v3/users/e2a4c18ba74147939eeedd6a74e2ff8f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:09.782426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:09.787437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:09.874756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ffc9314faf4803b8cdfe78316b9baa', 'request_id': 'req-39f6e958-3cef-459e-b437-f2390cae98c8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.898658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ffc9314faf4803b8cdfe78316b9baa', 'request_id': 'req-39f6e958-3cef-459e-b437-f2390cae98c8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.936277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ffc9314faf4803b8cdfe78316b9baa', 'request_id': 'req-39f6e958-3cef-459e-b437-f2390cae98c8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.971202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] The token cache is being invalidate because project a7ffc9314faf4803b8cdfe78316b9baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:09.971519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.979570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-39f6e958-3cef-459e-b437-f2390cae98c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:09.984524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 844/1683] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:09 2022] DELETE /identity/v3/projects/a7ffc9314faf4803b8cdfe78316b9baa => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:09.992467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:09.992808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:09.993107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:10.097584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:10.098897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:10.109075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d09be3-be9d-48d1-8880-7f6c6c445c79 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:10.371827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:10.372538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:10.372757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:10.373033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:10.374405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:10.376717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:10.403868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 845/1684] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:44:09 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:10.404852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:10.409055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:10.445335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 840/1685] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:09 2022] POST /identity/v3/projects => generated 369 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:10.447090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:10.452022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:10.466265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cee375-9b87-4287-adbb-6eaa5e42dfca None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:10.648917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1633c8-8abf-4f5d-9dd1-586609921112 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:10.673922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:10.674739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:10.675231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:10.675638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:10.676726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:10.679134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:10.722922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:10.728146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:10.728825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:10.729302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] PATH_INFO: `/v3/users/1e62dda4f7eb44b1b5253c020e6c1af9` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:10.732056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e62dda4f7eb44b1b5253c020e6c1af9)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:10.737567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:10.768979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 841/1686] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:10 2022] POST /identity/v3/users => generated 285 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:10.779892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:10.815789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af04245-9bed-4f74-af4c-25de928debea admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:10.841852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:10.842522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:10.843494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:10.844097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:10.844899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:10.846591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:10.861671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e62dda4f7eb44b1b5253c020e6c1af9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:10.877084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e62dda4f7eb44b1b5253c020e6c1af9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:10.878128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 842/1687] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:10.878841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e62dda4f7eb44b1b5253c020e6c1af9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:10.881396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e62dda4f7eb44b1b5253c020e6c1af9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:10.886022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:10.894453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:10.913933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e62dda4f7eb44b1b5253c020e6c1af9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:10.941139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 846/1688] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:10 2022] DELETE /identity/v3/users/1e62dda4f7eb44b1b5253c020e6c1af9 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:10.947896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:10.951412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:11.153424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f686a25-2f4f-428e-aadf-d2ec6e8d5f08 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:11.167506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:11.168604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:11.169120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:11.169643 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:11.170636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:11.181287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:11.189232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadadd5-e34a-4ecb-a08a-0b3e8cfe09f7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:11.198482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 847/1689] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:11.204112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:11.226834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739679b-bc14-45a7-b936-6c608f692362 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:11.240172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ba301-48a5-4ccb-b0d2-a6ea21245f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:11.241197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba301-48a5-4ccb-b0d2-a6ea21245f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:11.241672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba301-48a5-4ccb-b0d2-a6ea21245f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:11.242145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ba301-48a5-4ccb-b0d2-a6ea21245f56 admin admin] PATH_INFO: `/v3/projects/fb30da16f58247e094132bdd8065650d/users/f88cf69c0e5840a7bd7a163c2bf4e497/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:11.305128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ba301-48a5-4ccb-b0d2-a6ea21245f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb30da16f58247e094132bdd8065650d, user_id=f88cf69c0e5840a7bd7a163c2bf4e497, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:11.313559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ba301-48a5-4ccb-b0d2-a6ea21245f56 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:11.353847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 848/1690] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:11 2022] PUT /identity/v3/projects/fb30da16f58247e094132bdd8065650d/users/f88cf69c0e5840a7bd7a163c2bf4e497/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:11.355477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b6042-727a-4de0-9628-86efaa5f1e91 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:11.355872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b6042-727a-4de0-9628-86efaa5f1e91 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:11.356308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b6042-727a-4de0-9628-86efaa5f1e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:11.370996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:11.371883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:11.372874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:11.373379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:11.380728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:11.433372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:11.437852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:11.477345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 843/1691] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:10 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:11.501159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f71b6042-727a-4de0-9628-86efaa5f1e91 None None] MFA Rules not processed for user `f88cf69c0e5840a7bd7a163c2bf4e497`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:11.505325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f71b6042-727a-4de0-9628-86efaa5f1e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:11.726493 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 849/1692] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:11 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:11.728207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:11.742554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1b1ab-c67e-43ce-bfa3-c58c2d043f68 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:11.931396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:11.932043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:11.932343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:11.932633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:11.933290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:11.936925 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:12.005714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 844/1693] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:11 2022] POST /identity/v3/projects => generated 369 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:12.009922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b6042-727a-4de0-9628-86efaa5f1e91 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:12.026587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b6042-727a-4de0-9628-86efaa5f1e91 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:12.175470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:12.176128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:12.178344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:12.178660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:12.181980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:12.187235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:12.239893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 850/1694] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:12 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:12.241190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:12.262195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab0abe-e85c-4d21-a554-46dac13584cb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:12.278490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:12.279122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:12.279421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:12.279711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:12.280574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:12.282214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:12.315197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:12.327201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0203e8-0a9c-43ea-bbee-853ff2300fb0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:12.332139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 845/1695] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:12.342025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:12.343113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:12.343407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:12.343701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] PATH_INFO: `/v3/projects/ed98d66094f5455b9adfd66a79204181/users/43bddaa631ca4837b5cba378e84cbfa5/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:12.402441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:12.406995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:12.421306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed98d66094f5455b9adfd66a79204181, user_id=43bddaa631ca4837b5cba378e84cbfa5, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:12.427407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:12.449806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c98741-cadb-4a49-afed-1344548af8e6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:12.482851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 851/1696] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:12 2022] PUT /identity/v3/projects/ed98d66094f5455b9adfd66a79204181/users/43bddaa631ca4837b5cba378e84cbfa5/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:12.484906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:12.685484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb5fb-1bbe-489a-848f-5afd60817f0d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:12.693541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:12.694251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:12.694550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:12.694976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:12.695794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:12.697810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:12.712379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 852/1697] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:12.716106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:12.718656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:12.719570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:12.719771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:12.720103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] PATH_INFO: `/v3/projects/6f6fb8ef382748398bdfd38f45613014` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:12.727406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6fb8ef382748398bdfd38f45613014)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:12.734767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a441a-01a6-446f-b04e-b5b255c20c6a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:12.737853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:12.740396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94172e1d-038a-4f6f-8781-974d3ea6d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:12.741375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94172e1d-038a-4f6f-8781-974d3ea6d113 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:12.742063 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94172e1d-038a-4f6f-8781-974d3ea6d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:12.742952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94172e1d-038a-4f6f-8781-974d3ea6d113 admin admin] PATH_INFO: `/v3/projects/ed98d66094f5455b9adfd66a79204181/users/43bddaa631ca4837b5cba378e84cbfa5/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:12.745284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94172e1d-038a-4f6f-8781-974d3ea6d113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed98d66094f5455b9adfd66a79204181, user_id=43bddaa631ca4837b5cba378e84cbfa5, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:12.750492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94172e1d-038a-4f6f-8781-974d3ea6d113 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:12.768781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 853/1698] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:12 2022] PUT /identity/v3/projects/ed98d66094f5455b9adfd66a79204181/users/43bddaa631ca4837b5cba378e84cbfa5/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:12.782642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:12.783117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:12.783540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:12.849960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] MFA Rules not processed for user `43bddaa631ca4837b5cba378e84cbfa5`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:12.851801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:12.965400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6fb8ef382748398bdfd38f45613014', 'request_id': 'req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:12.979725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6fb8ef382748398bdfd38f45613014', 'request_id': 'req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:12.981077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 854/1699] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:12 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:12.993558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:12.995546 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:13.001681 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6fb8ef382748398bdfd38f45613014', 'request_id': 'req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.050645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] The token cache is being invalidate because project 6f6fb8ef382748398bdfd38f45613014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:13.050950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.051620 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.057829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 846/1700] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:12 2022] DELETE /identity/v3/projects/6f6fb8ef382748398bdfd38f45613014 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:13.062178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:13.069083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:13.093289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712f226-c644-4ed2-b99d-f1dcf946388c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:13.229476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:13.230082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:13.230376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:13.230947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:13.233080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:13.267027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8373ba-3a45-44e1-899a-0eaa2e04ccd1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:13.278104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:13.278944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:13.279238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:13.279531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] PATH_INFO: `/v3/users/b8eb8e515a1f4cc88d0b500edc8ee78b` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:13.284858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8eb8e515a1f4cc88d0b500edc8ee78b)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:13.286846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:13.400281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8eb8e515a1f4cc88d0b500edc8ee78b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.401512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8eb8e515a1f4cc88d0b500edc8ee78b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.406466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:13.407963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:13.416688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8eb8e515a1f4cc88d0b500edc8ee78b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.418012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8eb8e515a1f4cc88d0b500edc8ee78b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.426964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8eb8e515a1f4cc88d0b500edc8ee78b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.432275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 855/1701] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:12 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:13.433522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:13.455472 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:13.466622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 847/1702] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:13 2022] DELETE /identity/v3/users/b8eb8e515a1f4cc88d0b500edc8ee78b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:13.493222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459189d2-fce4-47a3-bf06-e85b70937533 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:13.564569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:13.565984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:13.659284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:13.663912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:13.667160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:13.667443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] PATH_INFO: `/v3/users/018d84b39d064bed8d7a16b1d4ecbf34` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:13.674479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=018d84b39d064bed8d7a16b1d4ecbf34)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:13.677450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:13.733227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c6428-6d13-4bda-9580-4a9de2ed642a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:13.736896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb13ad-fcbe-48eb-ab7c-e615b20cc4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:13.737702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb13ad-fcbe-48eb-ab7c-e615b20cc4ed service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:13.738025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb13ad-fcbe-48eb-ab7c-e615b20cc4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:13.738269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb13ad-fcbe-48eb-ab7c-e615b20cc4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:13.740355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-11eb13ad-fcbe-48eb-ab7c-e615b20cc4ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:13.778576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018d84b39d064bed8d7a16b1d4ecbf34'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.795892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018d84b39d064bed8d7a16b1d4ecbf34'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.797076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018d84b39d064bed8d7a16b1d4ecbf34'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.797736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018d84b39d064bed8d7a16b1d4ecbf34'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.819281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2791ab4c-d174-46a2-b5d6-2e7c8cefab2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018d84b39d064bed8d7a16b1d4ecbf34'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:13.855084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 856/1703] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:13 2022] DELETE /identity/v3/users/018d84b39d064bed8d7a16b1d4ecbf34 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:13.856579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:13.856929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:13.857221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:13.864525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb13ad-fcbe-48eb-ab7c-e615b20cc4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:13.866256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb13ad-fcbe-48eb-ab7c-e615b20cc4ed service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:13.882528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:13.883873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:13.894475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 848/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:13 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:14.030406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:14.030705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:14.031000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:14.052331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 857/1705] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:14.085462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] MFA Rules not processed for user `e8e3c70e491a4f0691f753c8e2b95e95`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:14.098066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:14.107232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:14.109205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:14.241866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 849/1706] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:14 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:14.311738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a73420-b004-453b-a37d-35f3284e5c7a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:14.330253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:14.332857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:14.333738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:14.334019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:14.351788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:14.364595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:14.386815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 858/1707] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:14 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:14.726305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:14.728421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:14.754758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c9235-dab1-45db-afa0-6b6a568a3c90 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:14.769858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:14.771077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:14.771371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:14.771655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] PATH_INFO: `/v3/projects/9fc25f65edd6433995fd2242536e3b43` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:14.774655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc25f65edd6433995fd2242536e3b43)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:14.776759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:14.865500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc25f65edd6433995fd2242536e3b43', 'request_id': 'req-41ef33f7-2def-4fb7-b1ba-14633997524f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:14.871685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc25f65edd6433995fd2242536e3b43', 'request_id': 'req-41ef33f7-2def-4fb7-b1ba-14633997524f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:14.887251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc25f65edd6433995fd2242536e3b43', 'request_id': 'req-41ef33f7-2def-4fb7-b1ba-14633997524f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:14.907648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:14.909651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:14.930890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] The token cache is being invalidate because project 9fc25f65edd6433995fd2242536e3b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:14.932168 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:14.933526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-41ef33f7-2def-4fb7-b1ba-14633997524f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:14.935799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 850/1708] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:14 2022] DELETE /identity/v3/projects/9fc25f65edd6433995fd2242536e3b43 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:14.943066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d9ff-fd6e-4d3a-8228-c82b12187497 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:14.943946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d9ff-fd6e-4d3a-8228-c82b12187497 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:14.944447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d9ff-fd6e-4d3a-8228-c82b12187497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:14.947011 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939d89-d4be-4e50-8236-ec4f2fec4793 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:14.994743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c547d9ff-fd6e-4d3a-8228-c82b12187497 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:14.996782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c547d9ff-fd6e-4d3a-8228-c82b12187497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.088971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:15.089798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.090091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.090378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] PATH_INFO: `/v3/projects/3d5abea9043b4fd589d63e6e3040f5a4` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.091498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 851/1709] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:15.093845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5abea9043b4fd589d63e6e3040f5a4)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:15.095802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:15.099420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4002b0-edbe-4831-9cd0-575581fbe83c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.100057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4002b0-edbe-4831-9cd0-575581fbe83c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.100541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4002b0-edbe-4831-9cd0-575581fbe83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.145908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-cd4002b0-edbe-4831-9cd0-575581fbe83c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:15.147199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-cd4002b0-edbe-4831-9cd0-575581fbe83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.174913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 852/1710] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:15.179044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4002b0-edbe-4831-9cd0-575581fbe83c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:15.194604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4002b0-edbe-4831-9cd0-575581fbe83c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:15.203862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5abea9043b4fd589d63e6e3040f5a4', 'request_id': 'req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:15.226246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5abea9043b4fd589d63e6e3040f5a4', 'request_id': 'req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:15.255877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5abea9043b4fd589d63e6e3040f5a4', 'request_id': 'req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:15.269202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] The token cache is being invalidate because project 3d5abea9043b4fd589d63e6e3040f5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:15.269496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:15.270169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb4f6881-e4d1-428d-930f-d96a8ea8dc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:15.271958 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 859/1711] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:14 2022] DELETE /identity/v3/projects/3d5abea9043b4fd589d63e6e3040f5a4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:15.276649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298855-f893-43a9-8559-78292f4ed5fd None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.277214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298855-f893-43a9-8559-78292f4ed5fd None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.277932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298855-f893-43a9-8559-78292f4ed5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.306973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a1298855-f893-43a9-8559-78292f4ed5fd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:15.308604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a1298855-f893-43a9-8559-78292f4ed5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.319845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:15.320449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.321297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.321593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.322445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:15.322753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:15.324582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:15.341331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 853/1712] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:15.348365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:15.350831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.371732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0865-c1d5-4008-9ba0-77d320321275 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:15.384310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa63417-25eb-4b6b-861e-9bd200b8f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:15.388006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 860/1713] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:15.388585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63417-25eb-4b6b-861e-9bd200b8f6cd admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.388702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63417-25eb-4b6b-861e-9bd200b8f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.389090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa63417-25eb-4b6b-861e-9bd200b8f6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.390625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63417-25eb-4b6b-861e-9bd200b8f6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:15.396376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa63417-25eb-4b6b-861e-9bd200b8f6cd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:15.402163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad682-94af-4b6d-9143-40ede484e767 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.404194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad682-94af-4b6d-9143-40ede484e767 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.404533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ad682-94af-4b6d-9143-40ede484e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.462849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 854/1714] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:15 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:15.464383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b005e-48f9-4ebb-bd41-3d63905fa1e2 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.464827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b005e-48f9-4ebb-bd41-3d63905fa1e2 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.465341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b005e-48f9-4ebb-bd41-3d63905fa1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.479465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-035ad682-94af-4b6d-9143-40ede484e767 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:15.480640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-035ad682-94af-4b6d-9143-40ede484e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.549922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-ea5b005e-48f9-4ebb-bd41-3d63905fa1e2 None None] MFA Rules not processed for user `008fc39c532a4a0ca8fc83e0d244a370`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:15.555760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ea5b005e-48f9-4ebb-bd41-3d63905fa1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.622993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 861/1715] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:15.630242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ad682-94af-4b6d-9143-40ede484e767 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:15.668623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ad682-94af-4b6d-9143-40ede484e767 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:15.681387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:15.682012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.685290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.687790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.688509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:15.694368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:15.741396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 862/1716] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:15 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:15.742152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:15.745553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.778831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c327d76-2da8-4a06-8661-6d91356f7609 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:15.781764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 855/1717] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:15 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:15.783839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b005e-48f9-4ebb-bd41-3d63905fa1e2 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:15.787676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:15.789438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.789737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.792096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] PATH_INFO: `/v3/projects/709f1520eee148e3911e56f61e41b2da` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.796708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709f1520eee148e3911e56f61e41b2da)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:15.801953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:15.812078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b005e-48f9-4ebb-bd41-3d63905fa1e2 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:15.826314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:15.828066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.828366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.828656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.831887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:15.832250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:15.833871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:15.868544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 856/1718] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:15.869401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:15.885291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478ecd5-8932-4cd9-a8ae-62386d21897b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:15.907503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:15.908966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:15.910985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:15.911532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:15.912530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:15.915873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:15.938776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 857/1719] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:15.939991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:15.943998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:15.969263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709f1520eee148e3911e56f61e41b2da', 'request_id': 'req-b7502625-ffc5-428f-b6af-97064dd48674'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.018861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709f1520eee148e3911e56f61e41b2da', 'request_id': 'req-b7502625-ffc5-428f-b6af-97064dd48674'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.041092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709f1520eee148e3911e56f61e41b2da', 'request_id': 'req-b7502625-ffc5-428f-b6af-97064dd48674'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.064682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] The token cache is being invalidate because project 709f1520eee148e3911e56f61e41b2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:16.064904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.066424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.073487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 863/1720] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:15 2022] DELETE /identity/v3/projects/709f1520eee148e3911e56f61e41b2da => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:16.073487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:16.076514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:16.088288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8c658-2014-4bf9-a3c8-b76f65f0802a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:16.210705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502625-ffc5-428f-b6af-97064dd48674 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:16.230002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:16.230637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:16.233447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:16.233756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:16.234438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:16.240123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:16.267972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:16.269066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:16.282432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:16.282992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:16.296673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:16.343901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 864/1721] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:16 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:16.346171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:16.352071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:16.498356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:16.500383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:16.522349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 858/1722] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:15 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:16.523224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:16.526520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:16.542327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9144c20-28f2-44b9-a596-f778032bfbdf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:16.581843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:16.582490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:16.582787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:16.583077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:16.583801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:16.593282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:16.596842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5837f-2f06-4935-812f-30a4f0fb1d53 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:16.618823 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:16.619630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:16.619947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:16.620299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] PATH_INFO: `/v3/users/1c33c9e7156f42b391963761487a0156` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:16.629170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c33c9e7156f42b391963761487a0156)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:16.629170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:16.633353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 865/1723] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:16.633353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:16.668853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154f0b-367e-40f2-91c8-7f3ac7a9a831 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:16.685577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:16.686753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:16.687665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:16.689561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:16.690689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:16.699811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:16.744885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c33c9e7156f42b391963761487a0156'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.748114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c33c9e7156f42b391963761487a0156'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.750468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 866/1724] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:16 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:16.757682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:16.783545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00c66-324b-4948-94fb-47211e4e09d2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:16.788469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bd99a-dc60-4835-91ca-b0ac06e3d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:16.789306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd99a-dc60-4835-91ca-b0ac06e3d0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:16.789597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd99a-dc60-4835-91ca-b0ac06e3d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:16.789882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bd99a-dc60-4835-91ca-b0ac06e3d0a4 admin admin] PATH_INFO: `/v3/projects/4d9cd9caf6f048a8bc54278cc1d31bf7/users/f69a429a851a4933ac34ee7c02664bcc/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:16.809810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c33c9e7156f42b391963761487a0156'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.813411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c33c9e7156f42b391963761487a0156'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.815473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bd99a-dc60-4835-91ca-b0ac06e3d0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9cd9caf6f048a8bc54278cc1d31bf7, user_id=f69a429a851a4933ac34ee7c02664bcc, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:16.818168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bd99a-dc60-4835-91ca-b0ac06e3d0a4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:16.838656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c33c9e7156f42b391963761487a0156'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:16.840057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 867/1725] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:16 2022] PUT /identity/v3/projects/4d9cd9caf6f048a8bc54278cc1d31bf7/users/f69a429a851a4933ac34ee7c02664bcc/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:16.841596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ab5a-34dc-4076-9018-461124e0d7d9 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:16.842750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ab5a-34dc-4076-9018-461124e0d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:16.843059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8ab5a-34dc-4076-9018-461124e0d7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:16.888943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 859/1726] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:16 2022] DELETE /identity/v3/users/1c33c9e7156f42b391963761487a0156 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:16.893018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:16.897254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:16.899828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a4a8ab5a-34dc-4076-9018-461124e0d7d9 None None] MFA Rules not processed for user `44a64fb1ebd9411eb6156c8ef97c3072`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:16.901326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a4a8ab5a-34dc-4076-9018-461124e0d7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:17.068177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 868/1727] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:16 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:17.069704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.071046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.071349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.089987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8327b-9c6b-48f2-b60f-a1ff987d4f8a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.102129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.103296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.103742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.104220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.105249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.107123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:17.133620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] MFA Rules not processed for user `f69a429a851a4933ac34ee7c02664bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:17.134759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 860/1728] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:17.136150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.136714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:17.161958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5b1fe-5773-4a6f-99c0-d4d2b07b5be4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.183832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.186633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.187809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.188258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.190625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.195223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:17.232574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 861/1729] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:17.235640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.262165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b8c1-7bd6-4897-9614-ab2a5497753f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.279440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dc2b0-df16-45ff-87f6-00d1f33ab48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.283199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc2b0-df16-45ff-87f6-00d1f33ab48e admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.283734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc2b0-df16-45ff-87f6-00d1f33ab48e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.284852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dc2b0-df16-45ff-87f6-00d1f33ab48e admin admin] PATH_INFO: `/v3/projects/832dc1bab8ce473c826397776a85bb82/users/3e89ef8773e64a02befec8fe8cfcd9b6/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.325642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc2b0-df16-45ff-87f6-00d1f33ab48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=832dc1bab8ce473c826397776a85bb82, user_id=3e89ef8773e64a02befec8fe8cfcd9b6, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.329358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dc2b0-df16-45ff-87f6-00d1f33ab48e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:17.348041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 869/1730] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:17 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:17.349141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.354969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 862/1731] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:17 2022] PUT /identity/v3/projects/832dc1bab8ce473c826397776a85bb82/users/3e89ef8773e64a02befec8fe8cfcd9b6/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:17.355147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:17.366356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1330036-7a03-450a-9379-1464dd61a9d9 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.382049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1330036-7a03-450a-9379-1464dd61a9d9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.382801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1330036-7a03-450a-9379-1464dd61a9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.399241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6158-5ee5-47f2-8eb9-f7e229c64c88 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.454880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d1330036-7a03-450a-9379-1464dd61a9d9 None None] MFA Rules not processed for user `3e89ef8773e64a02befec8fe8cfcd9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:17.465265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d1330036-7a03-450a-9379-1464dd61a9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:17.537627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.538662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.539809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.540429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.541551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.543981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:17.586506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 870/1732] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:17 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:17.590623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.654615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 863/1733] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:17 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:17.656547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1330036-7a03-450a-9379-1464dd61a9d9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.671328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1330036-7a03-450a-9379-1464dd61a9d9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.706649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810de1-4bea-4df1-8254-6a318adc2b0c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.712849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.713697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.714010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.714312 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.715005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.718512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:17.747768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 871/1734] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:17 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:17.754155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.787334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066233d1-1794-4bc7-8867-10a84f3b113f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.797650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.800024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.800332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.801556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.803830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.807334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:17.838201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 872/1735] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:17.839616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.844960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.845869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.846497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.848067 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.849918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.854005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:17.884143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98dde7-a70f-4635-b7ed-3a767bc339fd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:17.897614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:17.898478 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:17.900813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:17.901134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] PATH_INFO: `/v3/projects/eda519a76869428782c43e9f8e55ac66/users/d47707f2c7c54067829c924c9d0e5684/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:17.935887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 864/1736] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:17 2022] POST /identity/v3/projects => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:17.942049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:17.972610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda519a76869428782c43e9f8e55ac66, user_id=d47707f2c7c54067829c924c9d0e5684, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:17.981370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:18.038561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 873/1737] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:17 2022] PUT /identity/v3/projects/eda519a76869428782c43e9f8e55ac66/users/d47707f2c7c54067829c924c9d0e5684/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:18.039820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:18.137610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86bdf1-414f-4a69-b92e-c3bf427fec8d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:18.148382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6ec51-09e6-4f9c-892b-cd307d346242 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:18.153980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:18.154827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.155206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.155564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.156461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:18.158761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:18.175027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 874/1738] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:18.175951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:18.189463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a2097-5c05-47d6-9249-b33d3e226f7d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:18.194447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864458b7-f490-492a-b5d6-236782dea2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:18.195530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864458b7-f490-492a-b5d6-236782dea2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.195896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864458b7-f490-492a-b5d6-236782dea2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.196278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864458b7-f490-492a-b5d6-236782dea2bd admin admin] PATH_INFO: `/v3/projects/eda519a76869428782c43e9f8e55ac66/users/d47707f2c7c54067829c924c9d0e5684/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.199883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864458b7-f490-492a-b5d6-236782dea2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda519a76869428782c43e9f8e55ac66, user_id=d47707f2c7c54067829c924c9d0e5684, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:18.205468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864458b7-f490-492a-b5d6-236782dea2bd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:18.232519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 875/1739] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:18 2022] PUT /identity/v3/projects/eda519a76869428782c43e9f8e55ac66/users/d47707f2c7c54067829c924c9d0e5684/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:18.237738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404489-cbdb-460f-9f46-9348fd1e0422 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.238140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404489-cbdb-460f-9f46-9348fd1e0422 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.238660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab404489-cbdb-460f-9f46-9348fd1e0422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.277550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:18.278650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.279036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.279493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.280444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:18.283915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:18.342900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-ab404489-cbdb-460f-9f46-9348fd1e0422 None None] MFA Rules not processed for user `d47707f2c7c54067829c924c9d0e5684`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:18.344033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 865/1740] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:17 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:18.348055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:18.351105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:18.362519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ab404489-cbdb-460f-9f46-9348fd1e0422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:18.384428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d3a4e-d751-4079-a91e-59d93a7f84a0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:18.534202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:18.536545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.537009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.537452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] PATH_INFO: `/v3/projects/fbf7c1501c854af0ad367cde1956d5dd` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.538853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf7c1501c854af0ad367cde1956d5dd)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:18.541157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:18.578090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 876/1741] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:18 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:18.585453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404489-cbdb-460f-9f46-9348fd1e0422 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:18.605088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab404489-cbdb-460f-9f46-9348fd1e0422 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:18.622705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8cae-ac21-46e1-8447-a659ad2cbd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:18.624987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8cae-ac21-46e1-8447-a659ad2cbd98 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.624987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8cae-ac21-46e1-8447-a659ad2cbd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.624987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8cae-ac21-46e1-8447-a659ad2cbd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.630038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8cae-ac21-46e1-8447-a659ad2cbd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:18.633108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8cae-ac21-46e1-8447-a659ad2cbd98 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:18.673027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf7c1501c854af0ad367cde1956d5dd', 'request_id': 'req-79cb8d53-2731-4a95-9858-a9a697d0b2df'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:18.680066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 877/1742] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:18.682337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec8e89-2d6f-44c4-8b63-5b75c5f1c332 None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.684007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec8e89-2d6f-44c4-8b63-5b75c5f1c332 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.684553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec8e89-2d6f-44c4-8b63-5b75c5f1c332 None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.687768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 878/1743] 10.222.0.23 () {54 vars in 912 bytes} [Fri Apr 8 02:44:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:44:18.690718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf7c1501c854af0ad367cde1956d5dd', 'request_id': 'req-79cb8d53-2731-4a95-9858-a9a697d0b2df'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:18.691379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec8e89-2d6f-44c4-8b63-5b75c5f1c332 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:18.694498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c9ec8e89-2d6f-44c4-8b63-5b75c5f1c332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:18.701220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf7c1501c854af0ad367cde1956d5dd', 'request_id': 'req-79cb8d53-2731-4a95-9858-a9a697d0b2df'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:18.752284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] The token cache is being invalidate because project fbf7c1501c854af0ad367cde1956d5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:18.753048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:18.754885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:18.760753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 866/1744] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:18 2022] DELETE /identity/v3/projects/fbf7c1501c854af0ad367cde1956d5dd => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:18.761795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:18.766465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:18.816569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec8e89-2d6f-44c4-8b63-5b75c5f1c332 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:18.826132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571890e-fe70-48ee-b15e-9c32c835044c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:18.827776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571890e-fe70-48ee-b15e-9c32c835044c service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.828220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571890e-fe70-48ee-b15e-9c32c835044c service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.828826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571890e-fe70-48ee-b15e-9c32c835044c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.834240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0571890e-fe70-48ee-b15e-9c32c835044c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:18.941625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb8d53-2731-4a95-9858-a9a697d0b2df admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:18.955142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ff9d5-31e2-419c-8d84-8dc3c40f7361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:18.968259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ff9d5-31e2-419c-8d84-8dc3c40f7361 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:18.968538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ff9d5-31e2-419c-8d84-8dc3c40f7361 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:18.973000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ff9d5-31e2-419c-8d84-8dc3c40f7361 admin admin] PATH_INFO: `/v3/projects/f2f51a2d4f9f4ba7abf3e6cf377b5784/users/50c16e15d4eb47888df03b55b6f869d4/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:18.977832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571890e-fe70-48ee-b15e-9c32c835044c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:18.979444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571890e-fe70-48ee-b15e-9c32c835044c service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.015716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 879/1745] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:18 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:19.017414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b431c3-026e-4da0-b9db-b4c8bd4825d9 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.020089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b431c3-026e-4da0-b9db-b4c8bd4825d9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.026187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b431c3-026e-4da0-b9db-b4c8bd4825d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.047489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ff9d5-31e2-419c-8d84-8dc3c40f7361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f51a2d4f9f4ba7abf3e6cf377b5784, user_id=50c16e15d4eb47888df03b55b6f869d4, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:19.050171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ff9d5-31e2-419c-8d84-8dc3c40f7361 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.095365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 867/1746] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:18 2022] PUT /identity/v3/projects/f2f51a2d4f9f4ba7abf3e6cf377b5784/users/50c16e15d4eb47888df03b55b6f869d4/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:19.104807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-76b431c3-026e-4da0-b9db-b4c8bd4825d9 None None] MFA Rules not processed for user `865abd5c9d3b454ca1011e6e3111f580`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:19.105030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2694f20-1489-44b3-bc9a-44ef7abd1824 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.105286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2694f20-1489-44b3-bc9a-44ef7abd1824 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.105508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2694f20-1489-44b3-bc9a-44ef7abd1824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.106354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-76b431c3-026e-4da0-b9db-b4c8bd4825d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:19.189684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b2694f20-1489-44b3-bc9a-44ef7abd1824 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:19.191432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b2694f20-1489-44b3-bc9a-44ef7abd1824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:19.300238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 868/1747] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:19.300238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2694f20-1489-44b3-bc9a-44ef7abd1824 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.314671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2694f20-1489-44b3-bc9a-44ef7abd1824 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:19.329389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 880/1748] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:19.332287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9138d1-53ec-4f2a-b763-79f05c8544a9 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.332589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9138d1-53ec-4f2a-b763-79f05c8544a9 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.332884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9138d1-53ec-4f2a-b763-79f05c8544a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.335943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:19.336908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.337390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.337869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.338774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:19.340591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.353638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 869/1749] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:19.361098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.378104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2a9138d1-53ec-4f2a-b763-79f05c8544a9 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:19.379332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2a9138d1-53ec-4f2a-b763-79f05c8544a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:19.388188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 881/1750] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:19.395154 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9138d1-53ec-4f2a-b763-79f05c8544a9 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.397754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910299c5-4f58-4f86-9c18-097e9ab2c78b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:19.411783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9138d1-53ec-4f2a-b763-79f05c8544a9 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:19.412195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c28219-faae-431e-8ee9-41aa6fec9929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:19.417031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c28219-faae-431e-8ee9-41aa6fec9929 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.417674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c28219-faae-431e-8ee9-41aa6fec9929 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.419023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c28219-faae-431e-8ee9-41aa6fec9929 admin admin] PATH_INFO: `/v3/projects/f2f51a2d4f9f4ba7abf3e6cf377b5784/users/50c16e15d4eb47888df03b55b6f869d4/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.421634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:19.422252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.422573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.422864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.423652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:19.424008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:19.427596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c28219-faae-431e-8ee9-41aa6fec9929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f51a2d4f9f4ba7abf3e6cf377b5784, user_id=50c16e15d4eb47888df03b55b6f869d4, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:19.433135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.435093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c28219-faae-431e-8ee9-41aa6fec9929 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.469283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 882/1751] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:19.473443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.486377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 870/1752] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:19 2022] PUT /identity/v3/projects/f2f51a2d4f9f4ba7abf3e6cf377b5784/users/50c16e15d4eb47888df03b55b6f869d4/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:19.497192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ac85-960b-4c5f-acf9-d7ed76e5d652 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.497884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ac85-960b-4c5f-acf9-d7ed76e5d652 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.499033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ac85-960b-4c5f-acf9-d7ed76e5d652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.499774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825afe1-d090-4e94-9a7e-4feab0a38fce admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:19.590919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-43e6ac85-960b-4c5f-acf9-d7ed76e5d652 None None] MFA Rules not processed for user `50c16e15d4eb47888df03b55b6f869d4`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:19.597862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-43e6ac85-960b-4c5f-acf9-d7ed76e5d652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:19.666215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:19.668440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.670104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.671138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.672148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:19.678966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.746496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 883/1753] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:19 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:19.747579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.753269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:19.778497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 871/1754] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:19.779526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6ac85-960b-4c5f-acf9-d7ed76e5d652 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.801011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6ac85-960b-4c5f-acf9-d7ed76e5d652 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:19.865763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860f501-a165-4805-84a1-b7f93c2515c2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:19.874289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:19.875375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.875865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.876286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.886468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:19.888309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.899243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 884/1755] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:19 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:19.901485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.903369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:19.942972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:19.943598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:19.943900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:19.944217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:19.944879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:19.946822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:19.982824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 872/1756] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:19 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:19.983869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:19.988330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:19.999986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ce2d1-345f-452b-ac1a-76189769fc4a service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.008929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:20.009921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.010374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.010921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.011446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd5fc4-cd83-4c7e-ae07-cbdbb2f787f1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.025111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:20.025942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.026281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.026574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] PATH_INFO: `/v3/users/f88cf69c0e5840a7bd7a163c2bf4e497` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.034952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88cf69c0e5840a7bd7a163c2bf4e497)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:20.036954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:20.103826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:20.106024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:20.118794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 885/1757] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:19 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:20.119165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:20.125877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88cf69c0e5840a7bd7a163c2bf4e497'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.127372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88cf69c0e5840a7bd7a163c2bf4e497'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.129897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa33736-c3bf-4b8a-9958-e67be0fd6953 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.134769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:20.135515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.135814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.136134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.136848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:20.138528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:20.150100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 886/1758] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:20.153827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:20.157571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88cf69c0e5840a7bd7a163c2bf4e497'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.159827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88cf69c0e5840a7bd7a163c2bf4e497'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.164587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0422d7-73f0-4a42-80b0-a0ec4e26ef10 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.171240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:20.171240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.171240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.172003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.172548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:20.174343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:20.178265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e244ea29-5e41-4692-917d-cb442a1ab147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88cf69c0e5840a7bd7a163c2bf4e497'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.191419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 887/1759] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:20.192630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:20.194541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:20.209668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdae312-ce9f-4af7-83de-41007851061c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.210604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 873/1760] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:19 2022] DELETE /identity/v3/users/f88cf69c0e5840a7bd7a163c2bf4e497 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:20.214831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.215132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.215428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.263675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:20.266361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:20.334062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:20.335030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.335182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.335460 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] PATH_INFO: `/v3/projects/51688a04bf024bdeaa2b871d9ee5f64c/users/ca429c11ca7a488087b1c830db5b48e0/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.377699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51688a04bf024bdeaa2b871d9ee5f64c, user_id=ca429c11ca7a488087b1c830db5b48e0, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:20.385770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:20.411140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 874/1761] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:20.412311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:20.414266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:20.416430 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 888/1762] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:20 2022] PUT /identity/v3/projects/51688a04bf024bdeaa2b871d9ee5f64c/users/ca429c11ca7a488087b1c830db5b48e0/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:20.417284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:20.428039 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:20.552033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2934f-2d85-4201-9df4-691fefa41bb9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.589474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e8d99-f72d-427a-8108-52c591297fb8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.594544 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:20.595560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.595560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.595786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] PATH_INFO: `/v3/users/f69a429a851a4933ac34ee7c02664bcc` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.600758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69a429a851a4933ac34ee7c02664bcc)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:20.602698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:20.663186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:20.664434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.664884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.665315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.673387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:20.720131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69a429a851a4933ac34ee7c02664bcc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.728569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69a429a851a4933ac34ee7c02664bcc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.729902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69a429a851a4933ac34ee7c02664bcc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.730699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69a429a851a4933ac34ee7c02664bcc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.773020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f916a153-f0f5-4cff-b750-b4ac04163204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69a429a851a4933ac34ee7c02664bcc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:20.810183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 889/1763] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:20 2022] DELETE /identity/v3/users/f69a429a851a4933ac34ee7c02664bcc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:20.811789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:20.814921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:20.815797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:20.821306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:20.821674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:20.829209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 875/1764] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:20 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:20.830632 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:20.832574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:20.915105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226f8eb-9c0c-4783-8ffd-0f84b7e7c495 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:20.978287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] MFA Rules not processed for user `ca429c11ca7a488087b1c830db5b48e0`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:20.982463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:21.006392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd001b-9193-43e2-a8d0-d9dec5e64d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.007320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd001b-9193-43e2-a8d0-d9dec5e64d24 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.007736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd001b-9193-43e2-a8d0-d9dec5e64d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.008206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd001b-9193-43e2-a8d0-d9dec5e64d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.010526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b7fd001b-9193-43e2-a8d0-d9dec5e64d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:21.129699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd001b-9193-43e2-a8d0-d9dec5e64d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.132773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd001b-9193-43e2-a8d0-d9dec5e64d24 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.164298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 876/1765] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:21.182701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.183203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.185404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.219818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:21.221361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:21.235306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 877/1766] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:21.261252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:21.261475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 890/1767] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:20 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:21.266788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:21.267347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:21.268518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:21.293912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43c33-2c9d-4016-b362-1be2d06d067a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:21.297618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51967d26-ec71-4f1e-b392-d75f7cc964aa None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:21.303550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.304557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.305024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.305457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.309431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.310075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.311471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.311778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.312462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.319698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.320568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.322672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.339721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 878/1768] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:21.379681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 891/1769] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:21 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:21.383298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:21.394966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03529ee-bed3-48a1-b759-1ace86fada8d service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:21.501202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.502096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.502968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.506436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.507547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.510655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.545467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 879/1770] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:21 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:21.549133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:21.561604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb382db-3166-4292-bea6-8d231c25a899 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:21.570570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.571507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.572043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.572548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.573520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.577701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.612908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 892/1771] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:21.617572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:21.638425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc83eb4-caa4-49e8-bec6-b143d9ae09a3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:21.644126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.645394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.645690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.645974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] PATH_INFO: `/v3/projects/f2b7a7dc9b0b4a72abd65f2d91466ae0/users/a4e40d82e3db41e895f6f28c7b0dfb91/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.726233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b7a7dc9b0b4a72abd65f2d91466ae0, user_id=a4e40d82e3db41e895f6f28c7b0dfb91, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.739453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.773980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 880/1772] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:21 2022] PUT /identity/v3/projects/f2b7a7dc9b0b4a72abd65f2d91466ae0/users/a4e40d82e3db41e895f6f28c7b0dfb91/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:21.775469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:21.792659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6354b1f-d9fc-4b40-bd0e-d232e717c545 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:21.911634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682e339-9aed-4142-b0ed-4b27a244f03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.912278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682e339-9aed-4142-b0ed-4b27a244f03a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.912573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682e339-9aed-4142-b0ed-4b27a244f03a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.912929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682e339-9aed-4142-b0ed-4b27a244f03a admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.913867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682e339-9aed-4142-b0ed-4b27a244f03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.915206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682e339-9aed-4142-b0ed-4b27a244f03a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.929449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 893/1773] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:21.933211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:21.945475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8afbd2-6809-43c5-ae00-2a6bce86512f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:21.950876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:21.952416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.952814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.953205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] PATH_INFO: `/v3/projects/f2b7a7dc9b0b4a72abd65f2d91466ae0/users/a4e40d82e3db41e895f6f28c7b0dfb91/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:21.955301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b7a7dc9b0b4a72abd65f2d91466ae0, user_id=a4e40d82e3db41e895f6f28c7b0dfb91, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:21.958732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:21.977447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 881/1774] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:21 2022] PUT /identity/v3/projects/f2b7a7dc9b0b4a72abd65f2d91466ae0/users/a4e40d82e3db41e895f6f28c7b0dfb91/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:21.989700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:21.990631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:21.991072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:22.043081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] MFA Rules not processed for user `a4e40d82e3db41e895f6f28c7b0dfb91`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:22.044767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:22.057820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:22.060024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:22.177898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 894/1775] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:21 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:22.180206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d1af-2a7c-446d-b079-51def3d3788b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:22.190105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:22.191665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:22.194301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:22.195451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:22.195898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:22.196362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] PATH_INFO: `/v3/projects/fb30da16f58247e094132bdd8065650d` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:22.197677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb30da16f58247e094132bdd8065650d)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:22.199754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:22.331014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb30da16f58247e094132bdd8065650d', 'request_id': 'req-9abf82c1-7ec7-4b35-8200-5cccf788b29f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.337390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359394f-f8fb-46f9-9fca-2355fdd6b9ec None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:22.344557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb30da16f58247e094132bdd8065650d', 'request_id': 'req-9abf82c1-7ec7-4b35-8200-5cccf788b29f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.370735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb30da16f58247e094132bdd8065650d', 'request_id': 'req-9abf82c1-7ec7-4b35-8200-5cccf788b29f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.397750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] The token cache is being invalidate because project fb30da16f58247e094132bdd8065650d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:22.398115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.399153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.401584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 882/1776] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:22 2022] DELETE /identity/v3/projects/fb30da16f58247e094132bdd8065650d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:22.405979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:22.407676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:22.464305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:22.465404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:22.467480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:22.472860 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:22.477553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:22.519427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf82c1-7ec7-4b35-8200-5cccf788b29f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:22.524662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:22.525401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:22.525705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:22.526258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] PATH_INFO: `/v3/users/43bddaa631ca4837b5cba378e84cbfa5` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:22.527534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bddaa631ca4837b5cba378e84cbfa5)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:22.530251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:22.628891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bddaa631ca4837b5cba378e84cbfa5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.631215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bddaa631ca4837b5cba378e84cbfa5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.647255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:22.649845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:22.658201 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bddaa631ca4837b5cba378e84cbfa5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.659229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bddaa631ca4837b5cba378e84cbfa5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.676838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d36c8ec9-ba3d-4387-9a0f-61bc4e475921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bddaa631ca4837b5cba378e84cbfa5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:22.678039 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 895/1777] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:22 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:22.711711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 883/1778] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:22 2022] DELETE /identity/v3/users/43bddaa631ca4837b5cba378e84cbfa5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:22.781608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:22.783226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:22.829314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f4a5f-95d6-44ea-ac0c-bddc5b908e7c service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:22.977951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:22.978771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:22.979064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:22.979354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] PATH_INFO: `/v3/users/ca429c11ca7a488087b1c830db5b48e0` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:22.988007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca429c11ca7a488087b1c830db5b48e0)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:22.990075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:23.085909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca429c11ca7a488087b1c830db5b48e0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.095654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca429c11ca7a488087b1c830db5b48e0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.096588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca429c11ca7a488087b1c830db5b48e0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.098920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca429c11ca7a488087b1c830db5b48e0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.130886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca429c11ca7a488087b1c830db5b48e0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.168050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 896/1779] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:22 2022] DELETE /identity/v3/users/ca429c11ca7a488087b1c830db5b48e0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:23.172578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7bd5c-b658-407a-835c-160715ba7780 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:23.173591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7bd5c-b658-407a-835c-160715ba7780 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:23.174046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7bd5c-b658-407a-835c-160715ba7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:23.219514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c1a7bd5c-b658-407a-835c-160715ba7780 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:23.221861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c1a7bd5c-b658-407a-835c-160715ba7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:23.337120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:23.339152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:23.411774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 884/1780] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:23.411774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:23.411774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:23.411774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:23.518785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] MFA Rules not processed for user `008fc39c532a4a0ca8fc83e0d244a370`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:23.524904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:23.569920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18509d91-a0dd-4d7b-8c58-1dd7faa19191 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:23.586785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:23.587747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:23.588163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:23.588542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] PATH_INFO: `/v3/projects/4d9cd9caf6f048a8bc54278cc1d31bf7` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:23.591568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9cd9caf6f048a8bc54278cc1d31bf7)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:23.594177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:23.671274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 885/1781] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:23 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:23.672443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:23.674846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:23.711849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9cd9caf6f048a8bc54278cc1d31bf7', 'request_id': 'req-768845ce-d729-466e-9e53-93936d54ecd0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.740459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9cd9caf6f048a8bc54278cc1d31bf7', 'request_id': 'req-768845ce-d729-466e-9e53-93936d54ecd0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.781033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9cd9caf6f048a8bc54278cc1d31bf7', 'request_id': 'req-768845ce-d729-466e-9e53-93936d54ecd0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.813570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] The token cache is being invalidate because project 4d9cd9caf6f048a8bc54278cc1d31bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:23.822796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.823975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-768845ce-d729-466e-9e53-93936d54ecd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:23.827498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 897/1782] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:23 2022] DELETE /identity/v3/projects/4d9cd9caf6f048a8bc54278cc1d31bf7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:23.831878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a9f19-219b-4bbe-beb7-d13cdb6aa30c None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:23.833458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a9f19-219b-4bbe-beb7-d13cdb6aa30c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:23.834485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a9f19-219b-4bbe-beb7-d13cdb6aa30c None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:23.840168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 898/1783] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:44:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:44:23.841072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a9f19-219b-4bbe-beb7-d13cdb6aa30c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:23.848646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6e9a9f19-219b-4bbe-beb7-d13cdb6aa30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:23.894508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74131cf3-467f-4e9f-9551-6289a79b4de5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:23.984726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a9f19-219b-4bbe-beb7-d13cdb6aa30c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:23.991362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:23.992402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:23.992837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:23.993289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] PATH_INFO: `/v3/users/d47707f2c7c54067829c924c9d0e5684` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:23.995413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47707f2c7c54067829c924c9d0e5684)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:23.995558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83475010-0238-4190-beb2-a91300c04cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:23.996765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83475010-0238-4190-beb2-a91300c04cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:23.997063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83475010-0238-4190-beb2-a91300c04cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:23.997350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83475010-0238-4190-beb2-a91300c04cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:23.999480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-83475010-0238-4190-beb2-a91300c04cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:23.999770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:24.012686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83475010-0238-4190-beb2-a91300c04cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:24.015090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83475010-0238-4190-beb2-a91300c04cc6 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:24.026605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 886/1784] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:24.028191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df3b5c-fe44-4a1e-998e-900dbd53460d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:24.028491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df3b5c-fe44-4a1e-998e-900dbd53460d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:24.028843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df3b5c-fe44-4a1e-998e-900dbd53460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:24.057615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a1df3b5c-fe44-4a1e-998e-900dbd53460d None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:24.058801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a1df3b5c-fe44-4a1e-998e-900dbd53460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:24.069060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47707f2c7c54067829c924c9d0e5684'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.080394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47707f2c7c54067829c924c9d0e5684'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.081702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47707f2c7c54067829c924c9d0e5684'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.082474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47707f2c7c54067829c924c9d0e5684'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.113138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47707f2c7c54067829c924c9d0e5684'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.133776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 899/1785] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:23 2022] DELETE /identity/v3/users/d47707f2c7c54067829c924c9d0e5684 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:24.147244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 887/1786] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:44:24 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:24.410412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:24.413683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:24.573159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270286d-141f-4633-b9c3-45d3e03eacfa admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:24.588317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:24.589221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:24.589520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:24.589880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] PATH_INFO: `/v3/projects/ed98d66094f5455b9adfd66a79204181` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:24.591407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed98d66094f5455b9adfd66a79204181)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:24.596779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:24.687869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed98d66094f5455b9adfd66a79204181', 'request_id': 'req-58e43b33-65f6-4338-92c0-346fe3bab83c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.708346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed98d66094f5455b9adfd66a79204181', 'request_id': 'req-58e43b33-65f6-4338-92c0-346fe3bab83c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.741574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed98d66094f5455b9adfd66a79204181', 'request_id': 'req-58e43b33-65f6-4338-92c0-346fe3bab83c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.772471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] The token cache is being invalidate because project ed98d66094f5455b9adfd66a79204181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:24.772802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.774711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-58e43b33-65f6-4338-92c0-346fe3bab83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:24.784718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8a75-709a-452e-8ee2-0034e87bb636 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:24.785265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8a75-709a-452e-8ee2-0034e87bb636 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:24.785342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b8a75-709a-452e-8ee2-0034e87bb636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:24.789693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 900/1787] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:24 2022] DELETE /identity/v3/projects/ed98d66094f5455b9adfd66a79204181 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:24.817695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-313b8a75-709a-452e-8ee2-0034e87bb636 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:24.819073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-313b8a75-709a-452e-8ee2-0034e87bb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:24.975710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 888/1788] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:24.984796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565749d-cf36-4170-a30b-3e98d34511b3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:24.985448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565749d-cf36-4170-a30b-3e98d34511b3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:24.985947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565749d-cf36-4170-a30b-3e98d34511b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.039606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2565749d-cf36-4170-a30b-3e98d34511b3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:25.041130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2565749d-cf36-4170-a30b-3e98d34511b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:25.067318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 901/1789] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:25.069901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8a75-709a-452e-8ee2-0034e87bb636 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.089248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b8a75-709a-452e-8ee2-0034e87bb636 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.095529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.096180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.096513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.097341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.102213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:25.102617 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:25.104745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:25.128066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 889/1790] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:25.129390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565749d-cf36-4170-a30b-3e98d34511b3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.153777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565749d-cf36-4170-a30b-3e98d34511b3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.162121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.165668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:25.167986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.168610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.168901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.169187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.172817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:25.176971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:25.226363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 902/1791] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:25 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:25.229927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.346876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0186078-fdc1-4fb3-a1da-c0844b8124bd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.375085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7eabc-4ac1-4d64-95f7-a7b544f13b8c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.381811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.382672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.383157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.383622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.384880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:25.387405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:25.417478 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 903/1792] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:25 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:25.421879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.445045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e8b2b-8e6a-4df8-9d1a-63f6ea9ef7f7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.449484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.450119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.450623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.450863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.450989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.452570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.453132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.453588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.454520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:25.455649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:25.456796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:25.490698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 904/1793] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:25.492108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:25.493891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:25.494782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.510425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 890/1794] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:25 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:25.520398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028700bd-cc0c-46ab-a610-5d0078e3b6d7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.533983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df867584-88e2-4a75-a9eb-9eb94e90b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.534650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867584-88e2-4a75-a9eb-9eb94e90b331 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.534942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867584-88e2-4a75-a9eb-9eb94e90b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.535228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867584-88e2-4a75-a9eb-9eb94e90b331 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.536667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df867584-88e2-4a75-a9eb-9eb94e90b331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:25.539912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df867584-88e2-4a75-a9eb-9eb94e90b331 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:25.568999 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 905/1795] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:25.573277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.591063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c93d14-b756-4940-b1fe-a78557655298 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.597682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.598735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.599336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.599763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] PATH_INFO: `/v3/projects/7352dbdac8834a9a82da91c361517b04/users/06922d19a7724270968b53d7bde3fcbb/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.624274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7352dbdac8834a9a82da91c361517b04, user_id=06922d19a7724270968b53d7bde3fcbb, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:25.627120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:25.650931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 891/1796] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:25 2022] PUT /identity/v3/projects/7352dbdac8834a9a82da91c361517b04/users/06922d19a7724270968b53d7bde3fcbb/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:25.664248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:25.664749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:25.664843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:25.754271 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] MFA Rules not processed for user `06922d19a7724270968b53d7bde3fcbb`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:25.755497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:25.872171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.876485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 906/1797] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:25 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:25.970625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:25.972060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:25.992331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b6b9-7d07-4856-9337-29afb8e3b776 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:25.999250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:25.999861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.000243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.000536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.001189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.003106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.040302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 892/1798] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:25 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:26.041577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:26.095800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99988f3f-91c9-47c5-ac0f-8c08c7b9f961 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:26.132469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be4788-d5ef-411c-ac23-13e11053b61a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:26.139451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:26.140758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.141165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.141708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.142522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.145488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.195850 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:26.196584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 893/1799] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:26 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:26.199537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.199857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.200182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] PATH_INFO: `/v3/projects/eda519a76869428782c43e9f8e55ac66` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.200449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:26.201557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda519a76869428782c43e9f8e55ac66)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.203858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.217481 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75518-ec09-4b28-8339-f1af553ccacd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:26.229433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:26.230050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.230344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.230630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.231348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.237301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.251023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 894/1800] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:26.260064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:26.265069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:26.289955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda519a76869428782c43e9f8e55ac66', 'request_id': 'req-effa7d67-4be9-4416-9c09-cddf323ffca3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.298782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8871e-b159-47a1-b0c3-e3eb57dc9704 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:26.308644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda519a76869428782c43e9f8e55ac66', 'request_id': 'req-effa7d67-4be9-4416-9c09-cddf323ffca3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.333962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda519a76869428782c43e9f8e55ac66', 'request_id': 'req-effa7d67-4be9-4416-9c09-cddf323ffca3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.349920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] The token cache is being invalidate because project eda519a76869428782c43e9f8e55ac66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:26.350254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.350880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.352747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 907/1801] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:25 2022] DELETE /identity/v3/projects/eda519a76869428782c43e9f8e55ac66 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:26.353575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:26.356604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:26.406818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:26.408091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.409493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.410106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] PATH_INFO: `/v3/projects/51688a04bf024bdeaa2b871d9ee5f64c` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.411424 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51688a04bf024bdeaa2b871d9ee5f64c)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.413749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.504562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51688a04bf024bdeaa2b871d9ee5f64c', 'request_id': 'req-d1f531bd-4da4-4617-b7b1-03c3342078dc'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.529991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa7d67-4be9-4416-9c09-cddf323ffca3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:26.539775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51688a04bf024bdeaa2b871d9ee5f64c', 'request_id': 'req-d1f531bd-4da4-4617-b7b1-03c3342078dc'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.569743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51688a04bf024bdeaa2b871d9ee5f64c', 'request_id': 'req-d1f531bd-4da4-4617-b7b1-03c3342078dc'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.618785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] The token cache is being invalidate because project 51688a04bf024bdeaa2b871d9ee5f64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:26.619992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.622584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d1f531bd-4da4-4617-b7b1-03c3342078dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:26.626591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 895/1802] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:26 2022] DELETE /identity/v3/projects/51688a04bf024bdeaa2b871d9ee5f64c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:26.627881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.628208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.630613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.666392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:26.667701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:26.715153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:26.716130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.719308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.719308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] PATH_INFO: `/v3/projects/77338dd8dd2e4e3c97a276362ff69835/users/9cfbb605171d400e97afe26f9bb558b5/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.767647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=77338dd8dd2e4e3c97a276362ff69835, user_id=9cfbb605171d400e97afe26f9bb558b5, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.770454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.816654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 908/1803] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:26 2022] PUT /identity/v3/projects/77338dd8dd2e4e3c97a276362ff69835/users/9cfbb605171d400e97afe26f9bb558b5/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:26.819518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:26.828850 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 896/1804] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:26.830270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:26.832376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:26.834119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:26.846971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137b448-7e78-4338-9927-882cfb0aa095 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:26.950244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928df3e-5e32-4c58-8ba7-2085debc64ea admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:26.968687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:26.970188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.973528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.973831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] PATH_INFO: `/v3/users/a4e40d82e3db41e895f6f28c7b0dfb91` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.975356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e40d82e3db41e895f6f28c7b0dfb91)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.977970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.978697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b766365-6a8c-4d4e-938e-36fdfa586ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:26.979327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b766365-6a8c-4d4e-938e-36fdfa586ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.979625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b766365-6a8c-4d4e-938e-36fdfa586ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.979918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b766365-6a8c-4d4e-938e-36fdfa586ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:26.980730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b766365-6a8c-4d4e-938e-36fdfa586ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:26.982353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b766365-6a8c-4d4e-938e-36fdfa586ad1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:26.995840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 897/1805] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:26.997258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b69e5-b932-438d-8958-5dfbc9c22006 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:26.997630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b69e5-b932-438d-8958-5dfbc9c22006 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:26.997990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b69e5-b932-438d-8958-5dfbc9c22006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.048469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-aa6b69e5-b932-438d-8958-5dfbc9c22006 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:27.061194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-aa6b69e5-b932-438d-8958-5dfbc9c22006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.061592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e40d82e3db41e895f6f28c7b0dfb91'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.065286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 898/1806] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:27.066228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b69e5-b932-438d-8958-5dfbc9c22006 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.071280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e40d82e3db41e895f6f28c7b0dfb91'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.075440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e40d82e3db41e895f6f28c7b0dfb91'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.076928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e40d82e3db41e895f6f28c7b0dfb91'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.078505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b69e5-b932-438d-8958-5dfbc9c22006 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.084744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc234f8a-fed6-46de-8fff-7c4e979e1ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.086010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234f8a-fed6-46de-8fff-7c4e979e1ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.096979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234f8a-fed6-46de-8fff-7c4e979e1ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.097862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234f8a-fed6-46de-8fff-7c4e979e1ad9 admin admin] PATH_INFO: `/v3/projects/77338dd8dd2e4e3c97a276362ff69835/users/9cfbb605171d400e97afe26f9bb558b5/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.100647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc234f8a-fed6-46de-8fff-7c4e979e1ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77338dd8dd2e4e3c97a276362ff69835, user_id=9cfbb605171d400e97afe26f9bb558b5, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.104431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc234f8a-fed6-46de-8fff-7c4e979e1ad9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.109123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c261842f-4d47-425a-af96-08e8507a4aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e40d82e3db41e895f6f28c7b0dfb91'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.118007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 899/1807] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:27 2022] PUT /identity/v3/projects/77338dd8dd2e4e3c97a276362ff69835/users/9cfbb605171d400e97afe26f9bb558b5/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:27.119541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114055-5c0a-4d5c-bd72-b4ed015a4c9f None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.120018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114055-5c0a-4d5c-bd72-b4ed015a4c9f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.120294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61114055-5c0a-4d5c-bd72-b4ed015a4c9f None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.122247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 900/1808] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:44:27.123072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114055-5c0a-4d5c-bd72-b4ed015a4c9f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.125360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-61114055-5c0a-4d5c-bd72-b4ed015a4c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.135129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 909/1809] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:26 2022] DELETE /identity/v3/users/a4e40d82e3db41e895f6f28c7b0dfb91 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:27.136808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519a97-b606-4630-88e8-1fb1fe6f2073 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.143288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519a97-b606-4630-88e8-1fb1fe6f2073 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.143634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519a97-b606-4630-88e8-1fb1fe6f2073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.185105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c3519a97-b606-4630-88e8-1fb1fe6f2073 None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:27.187139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c3519a97-b606-4630-88e8-1fb1fe6f2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.254163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61114055-5c0a-4d5c-bd72-b4ed015a4c9f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.281847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 910/1810] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:44:27 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:27.283771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.284261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.284720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.342482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] MFA Rules not processed for user `9cfbb605171d400e97afe26f9bb558b5`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:27.344223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.350175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.350341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.350589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.350881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.351617 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:27.351936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.353540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.370531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 901/1811] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:27.370531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.374034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.389817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e2ae-a2c8-43eb-bc3f-ca779eb68940 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.397416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.398401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.398782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.399266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.410397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.412485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.424281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 902/1812] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:27 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:27.424923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.434754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc174816-b02a-4fde-8198-026a0c293eb3 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.440763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.441367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.441671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.442299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.443121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.445105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.445301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 911/1813] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:27 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:27.455919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.457394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.486192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 903/1814] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:27 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:27.490902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.548709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043796ca-fbe3-442d-9d90-22abbd6cfaa4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.582750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13325e4d-4651-4f2b-854d-c15063a83cd6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.587389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.588113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.588485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.588872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.589745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.591892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.611736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.612475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.612840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.613137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.627075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 904/1815] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:27 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:27.631674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.642527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c6478-6ef8-491d-b5c3-d6afd67d7973 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.647263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.647868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.648200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.648494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.649206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.651045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.662579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 905/1816] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:27.667211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.682498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30578cf-637f-48d9-8fe6-9022785b0b9c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.690270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.690880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.691182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.691469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.692206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.693869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.707962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 906/1817] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:27.711584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.718494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.719979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.722163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f646ab3-7de9-47b9-ba35-0c255cbf4f68 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.727660 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2455af5-37ca-4ecc-8d30-ddc3212bea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.728781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455af5-37ca-4ecc-8d30-ddc3212bea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.729251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455af5-37ca-4ecc-8d30-ddc3212bea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.729692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455af5-37ca-4ecc-8d30-ddc3212bea4b admin admin] PATH_INFO: `/v3/projects/59bad7ca7cd5462097e3819cc056f111/users/0fb3e0cd4fe24355a40aa3746fca2f9c/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.729821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 912/1818] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:27 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:27.753962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2455af5-37ca-4ecc-8d30-ddc3212bea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bad7ca7cd5462097e3819cc056f111, user_id=0fb3e0cd4fe24355a40aa3746fca2f9c, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.756672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2455af5-37ca-4ecc-8d30-ddc3212bea4b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.760555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.762278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.776905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b239f61-e28b-439a-9f6b-c608e87a20d5 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.780028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 907/1819] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:27 2022] PUT /identity/v3/projects/59bad7ca7cd5462097e3819cc056f111/users/0fb3e0cd4fe24355a40aa3746fca2f9c/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:27.784487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.784816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.785139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.835525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] MFA Rules not processed for user `0fb3e0cd4fe24355a40aa3746fca2f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:27.836746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.853682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.854522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.854835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.855109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] PATH_INFO: `/v3/users/06922d19a7724270968b53d7bde3fcbb` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.856273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06922d19a7724270968b53d7bde3fcbb)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.858249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.911567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06922d19a7724270968b53d7bde3fcbb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.913215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 908/1820] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:27 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:27.917785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.919127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.920180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06922d19a7724270968b53d7bde3fcbb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.920933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06922d19a7724270968b53d7bde3fcbb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.921561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06922d19a7724270968b53d7bde3fcbb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.932957 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b24fb1-70e7-4db9-8eea-400de6372e28 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:27.934687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06922d19a7724270968b53d7bde3fcbb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:27.937695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:27.938489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:27.938785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:27.939070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] PATH_INFO: `/v3/projects/f2b7a7dc9b0b4a72abd65f2d91466ae0` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:27.940228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b7a7dc9b0b4a72abd65f2d91466ae0)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:27.942156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:27.949654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 913/1821] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:27 2022] DELETE /identity/v3/users/06922d19a7724270968b53d7bde3fcbb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:27.950986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:27.953552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:27.994516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b7a7dc9b0b4a72abd65f2d91466ae0', 'request_id': 'req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.000310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b7a7dc9b0b4a72abd65f2d91466ae0', 'request_id': 'req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.009219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b7a7dc9b0b4a72abd65f2d91466ae0', 'request_id': 'req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.026288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ddf3a-cef3-46cd-a765-f1bcccaa5609 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.037678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] The token cache is being invalidate because project f2b7a7dc9b0b4a72abd65f2d91466ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:28.038392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.039300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e4c2f053-0cf4-4523-8c09-f8dfe500ab2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.041447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 909/1822] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:27 2022] DELETE /identity/v3/projects/f2b7a7dc9b0b4a72abd65f2d91466ae0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:28.043129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1485f-2165-484b-812e-acff5159bd05 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.043642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1485f-2165-484b-812e-acff5159bd05 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.044151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1485f-2165-484b-812e-acff5159bd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.073041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-78b1485f-2165-484b-812e-acff5159bd05 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:28.075047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-78b1485f-2165-484b-812e-acff5159bd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.100192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.100925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.101285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.101634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.103498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.176871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 910/1823] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:28.176871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.176871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.176871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.191032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.191798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.203366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 914/1824] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:27 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:28.204108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.205899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.229075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:28.230268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.238662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 911/1825] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:28.239457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.240646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.263413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9025aed-1f7d-4570-8c11-79aa122f9288 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.276967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.277787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.278078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.278361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] PATH_INFO: `/v3/users/0fb3e0cd4fe24355a40aa3746fca2f9c` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.280721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb3e0cd4fe24355a40aa3746fca2f9c)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.282851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.291842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c135b7-dbd9-46d0-992b-3c2063700752 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.296441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241ab27-85f3-4df0-96d4-327d6868e1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.297234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241ab27-85f3-4df0-96d4-327d6868e1ef service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.297515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241ab27-85f3-4df0-96d4-327d6868e1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.297800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241ab27-85f3-4df0-96d4-327d6868e1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.308078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241ab27-85f3-4df0-96d4-327d6868e1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.309474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241ab27-85f3-4df0-96d4-327d6868e1ef service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.321026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 915/1826] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:28.322434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883fe2-92ed-41e4-9cf6-8dc2cf61a01a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.322743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883fe2-92ed-41e4-9cf6-8dc2cf61a01a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.323021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883fe2-92ed-41e4-9cf6-8dc2cf61a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.336586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb3e0cd4fe24355a40aa3746fca2f9c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.337507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb3e0cd4fe24355a40aa3746fca2f9c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.349350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-d4883fe2-92ed-41e4-9cf6-8dc2cf61a01a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:28.350013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d4883fe2-92ed-41e4-9cf6-8dc2cf61a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.351286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb3e0cd4fe24355a40aa3746fca2f9c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.352120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb3e0cd4fe24355a40aa3746fca2f9c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.359485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 916/1827] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:28.363555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883fe2-92ed-41e4-9cf6-8dc2cf61a01a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.364661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-60c08b3f-9d60-470e-b42b-b164370a1b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb3e0cd4fe24355a40aa3746fca2f9c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:28.374906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883fe2-92ed-41e4-9cf6-8dc2cf61a01a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.380069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.380964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.381468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.381921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 912/1828] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:28 2022] DELETE /identity/v3/users/0fb3e0cd4fe24355a40aa3746fca2f9c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:28.382230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.383003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:28.383316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.385234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.387018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.387323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.387612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.403274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 917/1829] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:28.404417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.412866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:28.414088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.415425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391cef-e92d-4f0b-85dc-1cc74cef26ab admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.495562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.496124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 913/1830] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:28.496475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.496873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.497414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.498172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.500622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.509267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.514142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.535447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 918/1831] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:28.538470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.594004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4332db1-8b97-4856-8661-a9ef3ebdea7d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.620825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f37a7f-2123-47fa-ba71-c14ff10bdf72 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.625826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.626762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.627275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.627566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.628432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.630364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.658891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 919/1832] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:28.660068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.660674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.660970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.661255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.670391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.675633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.677291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.685188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71599-6e7f-4904-bd8b-4f41e4d9652e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.689301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 914/1833] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:28.690954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.691634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.692032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.692394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.693194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.694967 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.706945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 920/1834] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:28.710698 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.720555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7f7a7-cb70-4eab-9826-ebee547c9d35 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.725244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b387b4-bfed-4f20-9d34-86a32c641027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.725913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b387b4-bfed-4f20-9d34-86a32c641027 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.726282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b387b4-bfed-4f20-9d34-86a32c641027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.726682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b387b4-bfed-4f20-9d34-86a32c641027 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.727461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b387b4-bfed-4f20-9d34-86a32c641027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.729171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b387b4-bfed-4f20-9d34-86a32c641027 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.744523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 915/1835] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:28.749349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:28.759203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d87cb-da83-43d6-81a1-34c6c99f4040 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:28.763464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:28.764930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.765163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.765439 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] PATH_INFO: `/v3/projects/f00f13bc558e4237959e4154bd79bb70/users/d3f7442b95e54539aad911b819a6fd39/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.785278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00f13bc558e4237959e4154bd79bb70, user_id=d3f7442b95e54539aad911b819a6fd39, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:28.788032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:28.803032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 921/1836] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:28 2022] PUT /identity/v3/projects/f00f13bc558e4237959e4154bd79bb70/users/d3f7442b95e54539aad911b819a6fd39/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:28.815667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0dcf7-b1f3-432d-9be2-3d53a58c939e None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:28.815989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0dcf7-b1f3-432d-9be2-3d53a58c939e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:28.816297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0dcf7-b1f3-432d-9be2-3d53a58c939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:28.854150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4ac0dcf7-b1f3-432d-9be2-3d53a58c939e None None] MFA Rules not processed for user `d3f7442b95e54539aad911b819a6fd39`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:28.855347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4ac0dcf7-b1f3-432d-9be2-3d53a58c939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:28.933667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 916/1837] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:28.938563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.014708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585e1e2-d3ae-4585-b2e5-1c85aa1ca22c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.019529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.020102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.020401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.020689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.021338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.023379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.062770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 922/1838] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:28 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:29.064026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0dcf7-b1f3-432d-9be2-3d53a58c939e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.080634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0dcf7-b1f3-432d-9be2-3d53a58c939e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.111061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.113339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.176498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.177113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.177531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.178025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.178770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.180599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.202147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 917/1839] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:29.207386 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.208247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edefc1-ea60-4a32-b2a4-5cd3656742a9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.219584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.220312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74776010-e825-4b8a-9906-7f2cf1b25882 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.221714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.222230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.222799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] PATH_INFO: `/v3/projects/7352dbdac8834a9a82da91c361517b04` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.225506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7352dbdac8834a9a82da91c361517b04)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.225695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.226367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.226778 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.227137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.227915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.229219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.229657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.255850 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 918/1840] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:29.258851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.270248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca7cc0-834a-4bdc-86c2-eb9619fa9636 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.275372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.275852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.276490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.276622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] PATH_INFO: `/v3/projects/8a1e3f93b62042f4b0fa01fec00f69ba/users/763e023e102c4f08baf3253025b77772/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.298737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1e3f93b62042f4b0fa01fec00f69ba, user_id=763e023e102c4f08baf3253025b77772, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.302055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.324038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 919/1841] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:29 2022] PUT /identity/v3/projects/8a1e3f93b62042f4b0fa01fec00f69ba/users/763e023e102c4f08baf3253025b77772/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:29.324038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.325239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.331725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7352dbdac8834a9a82da91c361517b04', 'request_id': 'req-8d71e585-16b5-4c5d-affe-16b3734668d7'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.342844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7352dbdac8834a9a82da91c361517b04', 'request_id': 'req-8d71e585-16b5-4c5d-affe-16b3734668d7'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.357103 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7352dbdac8834a9a82da91c361517b04', 'request_id': 'req-8d71e585-16b5-4c5d-affe-16b3734668d7'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.370287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] The token cache is being invalidate because project 7352dbdac8834a9a82da91c361517b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:29.370984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.374718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.376667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 923/1842] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:29 2022] DELETE /identity/v3/projects/7352dbdac8834a9a82da91c361517b04 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:29.378230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.380534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.436678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055afd4f-bc6a-4afe-84b6-6cd6db46753f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.450116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.451508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.453916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.454269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] PATH_INFO: `/v3/projects/59bad7ca7cd5462097e3819cc056f111` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.455557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bad7ca7cd5462097e3819cc056f111)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.457622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.484777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71e585-16b5-4c5d-affe-16b3734668d7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.490869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.491497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.491681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.492130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.492836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.494629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.508570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 924/1843] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:29.509482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.511239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.521264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bad7ca7cd5462097e3819cc056f111', 'request_id': 'req-9a75652b-f21d-4b6e-8cf0-6d11855b5114'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.523964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84e996-d31e-4b42-822c-00bf8d146469 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.527464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bad7ca7cd5462097e3819cc056f111', 'request_id': 'req-9a75652b-f21d-4b6e-8cf0-6d11855b5114'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.537279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bad7ca7cd5462097e3819cc056f111', 'request_id': 'req-9a75652b-f21d-4b6e-8cf0-6d11855b5114'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.555800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] The token cache is being invalidate because project 59bad7ca7cd5462097e3819cc056f111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:29.556135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.556817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.558296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 920/1844] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:29 2022] DELETE /identity/v3/projects/59bad7ca7cd5462097e3819cc056f111 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:29.559032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.561080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.594977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.596357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.596849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.597209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] PATH_INFO: `/v3/users/9cfbb605171d400e97afe26f9bb558b5` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.598432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cfbb605171d400e97afe26f9bb558b5)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.600459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.634192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75652b-f21d-4b6e-8cf0-6d11855b5114 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.639392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb784fa-2adc-4e3e-be0d-9c49900ee607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.640494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb784fa-2adc-4e3e-be0d-9c49900ee607 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.640883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb784fa-2adc-4e3e-be0d-9c49900ee607 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.641929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb784fa-2adc-4e3e-be0d-9c49900ee607 admin admin] PATH_INFO: `/v3/projects/8a1e3f93b62042f4b0fa01fec00f69ba/users/763e023e102c4f08baf3253025b77772/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.643863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb784fa-2adc-4e3e-be0d-9c49900ee607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1e3f93b62042f4b0fa01fec00f69ba, user_id=763e023e102c4f08baf3253025b77772, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.646734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb784fa-2adc-4e3e-be0d-9c49900ee607 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.657511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfbb605171d400e97afe26f9bb558b5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.658518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 921/1845] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:29 2022] PUT /identity/v3/projects/8a1e3f93b62042f4b0fa01fec00f69ba/users/763e023e102c4f08baf3253025b77772/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:29.659559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926966-b334-44bf-8112-22ff30df47e0 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.659905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926966-b334-44bf-8112-22ff30df47e0 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.660228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9926966-b334-44bf-8112-22ff30df47e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.673736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfbb605171d400e97afe26f9bb558b5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.674758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfbb605171d400e97afe26f9bb558b5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.675562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfbb605171d400e97afe26f9bb558b5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.687155 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b9926966-b334-44bf-8112-22ff30df47e0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.688711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b9926966-b334-44bf-8112-22ff30df47e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.710171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d4aeb009-8555-4ad9-adbc-0d837edfcc23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfbb605171d400e97afe26f9bb558b5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:29.733583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 925/1846] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:29 2022] DELETE /identity/v3/users/9cfbb605171d400e97afe26f9bb558b5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:29.737758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb86d-86d9-46ca-9733-226c0fcf9b5c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.738140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb86d-86d9-46ca-9733-226c0fcf9b5c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.738499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aceb86d-86d9-46ca-9733-226c0fcf9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.781589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 922/1847] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.781758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9aceb86d-86d9-46ca-9733-226c0fcf9b5c None None] MFA Rules not processed for user `763e023e102c4f08baf3253025b77772`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.782919 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9aceb86d-86d9-46ca-9733-226c0fcf9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.789344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.790127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.790632 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.815371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:29.816606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.889106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 926/1848] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:29.895907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 923/1849] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:29.900592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aceb86d-86d9-46ca-9733-226c0fcf9b5c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.903011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.905302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:29.914565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aceb86d-86d9-46ca-9733-226c0fcf9b5c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.921920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.922835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.923195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.923573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.924431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:29.924928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.926667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.945060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 927/1850] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:29.946773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:29.971815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016e615-fb6b-4e28-8ade-6c3fff7b5029 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.983072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.983913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.984508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.984938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:29.985837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:29.988204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:29.991048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d79e8-a227-4b53-b10f-a0d2d864b9b6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:29.995631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:29.996438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:29.996840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:29.997229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.009108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.011063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:30.025868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 924/1851] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:29 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:30.073682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 928/1852] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:29 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:30.079285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.094986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d041-cdea-4ee9-b970-bc81baaf3646 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.235177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.236214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.236726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.237219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.238087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.240729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:30.290678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 925/1853] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:30.295391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.310094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694c702-faf9-401f-afac-c027501b4ede admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.324658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.325455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.325857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.326883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.327859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.330075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:30.346300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 929/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:30.347565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.359250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8426b0-dd77-4315-9f67-05cf7f0a19f9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.381355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9707ffc-5b41-4574-a545-a67385c2c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.382291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9707ffc-5b41-4574-a545-a67385c2c9cf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.382993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9707ffc-5b41-4574-a545-a67385c2c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.383425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9707ffc-5b41-4574-a545-a67385c2c9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.385786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9707ffc-5b41-4574-a545-a67385c2c9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.392563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9707ffc-5b41-4574-a545-a67385c2c9cf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:30.406401 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 926/1855] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:30.410915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.434638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a099ec-1639-4c3a-90a9-5113b950318a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.467970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.469064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.470454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.471744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] PATH_INFO: `/v3/projects/a2e3b2b95b6b4e69918aae4ad67d8e4e/users/db513b63adc14f8fb725183909b09d5f/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.542108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e3b2b95b6b4e69918aae4ad67d8e4e, user_id=db513b63adc14f8fb725183909b09d5f, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.544856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:30.588623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 930/1856] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:30 2022] PUT /identity/v3/projects/a2e3b2b95b6b4e69918aae4ad67d8e4e/users/db513b63adc14f8fb725183909b09d5f/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:30.600268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.600587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.600884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.694256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] MFA Rules not processed for user `db513b63adc14f8fb725183909b09d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:30.698102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:30.768840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.905064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 927/1857] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:30.913558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:30.914993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:30.947447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e033e-fd24-4f3c-8549-5a5c8c8d4a7d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:30.958527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763e023e102c4f08baf3253025b77772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1e3f93b62042f4b0fa01fec00f69ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:30.959302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:30.959621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:30.959944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:30.960722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:30.961073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:30.969377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:31.001702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 931/1858] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:31.002720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.034379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c01c77-3bad-49a6-93b1-628ec73d9c3e tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.061532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763e023e102c4f08baf3253025b77772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1e3f93b62042f4b0fa01fec00f69ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.063194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.064315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.075449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.076902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.078812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:31.081029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd856f60-4ef2-478f-a90f-e6335bc5c8de None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.092466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.093420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.093531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.093819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.112086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.114101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:31.137310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 928/1859] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:30 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:31.153208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 932/1860] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/projects => generated 352 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:31.154050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.169592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a801c6-cf66-4578-9ccc-b5b2366fdafb service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.330581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763e023e102c4f08baf3253025b77772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1e3f93b62042f4b0fa01fec00f69ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.333462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.333963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.335805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.337534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:31.340748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.343967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:31.378116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 929/1861] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:31.453825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.455711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.646490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1e0f-207c-427a-a951-bb0adb09c9a2 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.651614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.652733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.653163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.653579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] PATH_INFO: `/v3/projects/77338dd8dd2e4e3c97a276362ff69835` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.655293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77338dd8dd2e4e3c97a276362ff69835)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:31.660325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:31.766593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77338dd8dd2e4e3c97a276362ff69835', 'request_id': 'req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:31.802057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77338dd8dd2e4e3c97a276362ff69835', 'request_id': 'req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:31.838137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77338dd8dd2e4e3c97a276362ff69835', 'request_id': 'req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:31.862637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:31.868010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] The token cache is being invalidate because project 77338dd8dd2e4e3c97a276362ff69835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:31.870208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:31.871997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dd25b1f6-caa6-48ed-b7a9-d5421165d95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:31.872542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f3765-2275-46ae-81d8-8c56cb4afd66 tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:31.879839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 933/1862] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:31 2022] DELETE /identity/v3/projects/77338dd8dd2e4e3c97a276362ff69835 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:31.884413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256130-1323-4199-82e1-7e2e440b1313 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.884998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256130-1323-4199-82e1-7e2e440b1313 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.885500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256130-1323-4199-82e1-7e2e440b1313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.915638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c4256130-1323-4199-82e1-7e2e440b1313 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:31.917177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c4256130-1323-4199-82e1-7e2e440b1313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:31.994774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763e023e102c4f08baf3253025b77772', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1e3f93b62042f4b0fa01fec00f69ba', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:31.995914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:31.996659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:31.997195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] PATH_INFO: `/v3/projects/410ecc8fe5924327941e46297b229148` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:31.999220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorizing `identity:delete_project(project_id=410ecc8fe5924327941e46297b229148)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.001742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.015341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 934/1863] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:32.016914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d48b-5c45-4b9a-bd7e-8acd9ccc273f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.017215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d48b-5c45-4b9a-bd7e-8acd9ccc273f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.017499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d48b-5c45-4b9a-bd7e-8acd9ccc273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.068620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5937d48b-5c45-4b9a-bd7e-8acd9ccc273f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:32.069830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5937d48b-5c45-4b9a-bd7e-8acd9ccc273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.095214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410ecc8fe5924327941e46297b229148', 'request_id': 'req-bdf52a20-26f3-4018-96e4-aa38a2b9891b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.105857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410ecc8fe5924327941e46297b229148', 'request_id': 'req-bdf52a20-26f3-4018-96e4-aa38a2b9891b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.127647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410ecc8fe5924327941e46297b229148', 'request_id': 'req-bdf52a20-26f3-4018-96e4-aa38a2b9891b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.173962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] The token cache is being invalidate because project 410ecc8fe5924327941e46297b229148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:32.174267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.174935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.180877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 930/1864] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:31 2022] DELETE /identity/v3/projects/410ecc8fe5924327941e46297b229148 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:32.183803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 935/1865] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:32.188657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.200290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf52a20-26f3-4018-96e4-aa38a2b9891b tempest-VolumeQuotaClassesTest-104301287 tempest-VolumeQuotaClassesTest-104301287-project-admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.205019 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.205700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.206066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.206474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.207253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:32.207690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.209469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.230379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 931/1866] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:32.235239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d48b-5c45-4b9a-bd7e-8acd9ccc273f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.245457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937d48b-5c45-4b9a-bd7e-8acd9ccc273f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.252772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.253944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.254437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.255731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.257030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.259399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.330171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 936/1867] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:32.334855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.351716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d7856-bf4e-4fd7-ba64-b355b4a284f3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.467443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.468250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.468615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.468971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.469688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.472069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.496322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 932/1868] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:32.500878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.515905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43714e-df47-449e-8fc9-9b795a49b9d4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.522820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.523533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.524699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.525134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.526000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.528444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.543287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 937/1869] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:32.547392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.559025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc5438-746c-4b36-b07a-11ff22d884ec admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.564911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.565747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.566046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.566572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.567762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.569829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.597001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 933/1870] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:32.601434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.613371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.615120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.615294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464691-861a-4d1c-ba56-e7b6a93d1d4b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.620004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f4ee2-968d-421a-a381-4f26997fdcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.620861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4ee2-968d-421a-a381-4f26997fdcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.621159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4ee2-968d-421a-a381-4f26997fdcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.621451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4ee2-968d-421a-a381-4f26997fdcb0 admin admin] PATH_INFO: `/v3/projects/e11e6ea2acee4c9db5fcd9f3e9d2cc89/users/269cad5784a347689e154ca5d3c5d45d/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.627796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f32cff-d0c8-4cc2-8fc0-e6c9d1c6280c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.632562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.633371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.633670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.633963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] PATH_INFO: `/v3/users/d3f7442b95e54539aad911b819a6fd39` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.635170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f7442b95e54539aad911b819a6fd39)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.637162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.647166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4ee2-968d-421a-a381-4f26997fdcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11e6ea2acee4c9db5fcd9f3e9d2cc89, user_id=269cad5784a347689e154ca5d3c5d45d, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.650099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4ee2-968d-421a-a381-4f26997fdcb0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.667108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 938/1871] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:32 2022] PUT /identity/v3/projects/e11e6ea2acee4c9db5fcd9f3e9d2cc89/users/269cad5784a347689e154ca5d3c5d45d/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:32.680402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.680697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.680985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.722868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f7442b95e54539aad911b819a6fd39'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.723614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f7442b95e54539aad911b819a6fd39'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.728024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] MFA Rules not processed for user `269cad5784a347689e154ca5d3c5d45d`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:32.729205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.737496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f7442b95e54539aad911b819a6fd39'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.738189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f7442b95e54539aad911b819a6fd39'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.746289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-57d827d3-284d-49e0-aefc-13ff90527351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f7442b95e54539aad911b819a6fd39'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:32.765730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 934/1872] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:32 2022] DELETE /identity/v3/users/d3f7442b95e54539aad911b819a6fd39 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:32.770170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.770626 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.771059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.799489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:32.801575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.822523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 939/1873] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:32.823683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.825477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.889174 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 935/1874] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:32.923592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:32.923789 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f36ca-cee6-4317-a816-0b6b71e75e5a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:32.925462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:32.929123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:32.929729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:32.930184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:32.930486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:32.931143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:32.933111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:32.976838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 940/1875] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:32.977872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.016353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d09de-0917-4800-ac48-37304d2e42f3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.091353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174eb4b-a432-44bd-8f76-be9784e6d137 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.099153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.100454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.100904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.101337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.102146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.105743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:33.114508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.115528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.115726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.116217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.142312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.142865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 941/1876] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:32 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:33.144190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.145733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:33.156866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36f561-d51f-47ba-8c7b-5528eb98b9c5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.159852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 936/1877] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:33.161952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.162583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.162876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.163339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.164237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.165846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:33.181418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 942/1878] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:33.182509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.196037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86106f-b549-42a7-b3c4-37b448bfaec9 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.206525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.207493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.207853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.208182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] PATH_INFO: `/v3/projects/0752b9f2719c48889fd5569ffb9666bf/users/9c49285324de4713ae9582e6aee008eb/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.236184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0752b9f2719c48889fd5569ffb9666bf, user_id=9c49285324de4713ae9582e6aee008eb, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.239452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:33.261714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.262085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 937/1879] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:33 2022] PUT /identity/v3/projects/0752b9f2719c48889fd5569ffb9666bf/users/9c49285324de4713ae9582e6aee008eb/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:33.273976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2d2c-e646-4b28-a414-8de9a348d43e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.413884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a07cc-01d2-4ae1-987c-eed592952207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.414839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a07cc-01d2-4ae1-987c-eed592952207 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.415335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a07cc-01d2-4ae1-987c-eed592952207 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.415853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a07cc-01d2-4ae1-987c-eed592952207 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.417074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a07cc-01d2-4ae1-987c-eed592952207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.421194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a07cc-01d2-4ae1-987c-eed592952207 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:33.452089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 943/1880] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:33.457867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.475134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c2340-eaa8-4558-a4b4-632cfe0009dc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:33.488977 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:33.490361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.490899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.491389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] PATH_INFO: `/v3/projects/0752b9f2719c48889fd5569ffb9666bf/users/9c49285324de4713ae9582e6aee008eb/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.516002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0752b9f2719c48889fd5569ffb9666bf, user_id=9c49285324de4713ae9582e6aee008eb, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:33.521637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:33.535825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 938/1881] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:33 2022] PUT /identity/v3/projects/0752b9f2719c48889fd5569ffb9666bf/users/9c49285324de4713ae9582e6aee008eb/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:33.557735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165870b0-80c2-4acf-845d-9090e90799d2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:33.558489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165870b0-80c2-4acf-845d-9090e90799d2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:33.559015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165870b0-80c2-4acf-845d-9090e90799d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:33.646894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-165870b0-80c2-4acf-845d-9090e90799d2 None None] MFA Rules not processed for user `9c49285324de4713ae9582e6aee008eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:33.653288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-165870b0-80c2-4acf-845d-9090e90799d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:33.800456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 944/1882] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:33 2022] POST /identity/v3/auth/tokens => generated 3765 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:33.837246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:33.839649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:34.005977 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20951f1a-e741-4065-a283-5247845586d7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:34.011506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:34.012136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:34.012434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:34.012723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:34.024869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:34.026319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:34.041274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 939/1883] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:33 2022] GET /identity/v3/auth/tokens => generated 3765 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:34.229674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165870b0-80c2-4acf-845d-9090e90799d2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:34.247328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165870b0-80c2-4acf-845d-9090e90799d2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:34.253121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:34.253799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:34.254127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:34.254413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:34.326111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:34.328480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:34.377679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:34.379461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:34.397824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 945/1884] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:34 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:34.434905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fe48a-e22c-4bd4-96bf-4b9c1ad11e1d service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:34.469339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:34.470163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:34.470459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:34.470747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] PATH_INFO: `/v3/projects/f00f13bc558e4237959e4154bd79bb70` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:34.471964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f00f13bc558e4237959e4154bd79bb70)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:34.473900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:34.595521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f00f13bc558e4237959e4154bd79bb70', 'request_id': 'req-d006373c-3d8d-4bfe-b560-201f85ad9cac'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.607327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f00f13bc558e4237959e4154bd79bb70', 'request_id': 'req-d006373c-3d8d-4bfe-b560-201f85ad9cac'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.628244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f00f13bc558e4237959e4154bd79bb70', 'request_id': 'req-d006373c-3d8d-4bfe-b560-201f85ad9cac'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.664674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] The token cache is being invalidate because project f00f13bc558e4237959e4154bd79bb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:34.665359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.666751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.671809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 940/1885] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:34 2022] DELETE /identity/v3/projects/f00f13bc558e4237959e4154bd79bb70 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:34.676807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:34.691128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b8bc6-1578-4f7e-a55a-375d56a3f980 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:34.834231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:34.835688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:34.836056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:34.836489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] PATH_INFO: `/v3/users/763e023e102c4f08baf3253025b77772` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:34.837929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] RBAC: Authorizing `identity:delete_user(user_id=763e023e102c4f08baf3253025b77772)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:34.842680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:34.965878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763e023e102c4f08baf3253025b77772'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.986615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763e023e102c4f08baf3253025b77772'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.987374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763e023e102c4f08baf3253025b77772'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:34.988009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763e023e102c4f08baf3253025b77772'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.021422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-2dd17f2d-29b4-4721-9fd6-417a512f826e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763e023e102c4f08baf3253025b77772'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:35.049540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 946/1886] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:34 2022] DELETE /identity/v3/users/763e023e102c4f08baf3253025b77772 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:35.989743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:35.992402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:36.006112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006373c-3d8d-4bfe-b560-201f85ad9cac admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:36.077112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:36.078021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.078317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.078606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] PATH_INFO: `/v3/projects/8a1e3f93b62042f4b0fa01fec00f69ba` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.079790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1e3f93b62042f4b0fa01fec00f69ba)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:36.081976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:36.140324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1e3f93b62042f4b0fa01fec00f69ba', 'request_id': 'req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.146737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1e3f93b62042f4b0fa01fec00f69ba', 'request_id': 'req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.158938 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1e3f93b62042f4b0fa01fec00f69ba', 'request_id': 'req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.178148 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] The token cache is being invalidate because project 8a1e3f93b62042f4b0fa01fec00f69ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:36.178443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.179119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2babcb62-ea1c-4f58-b1dd-bda3c29ed285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.183803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 941/1887] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:35 2022] DELETE /identity/v3/projects/8a1e3f93b62042f4b0fa01fec00f69ba => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:36.186846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1c8e-dfe2-4a31-b2a9-f08b143a341b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.187736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1c8e-dfe2-4a31-b2a9-f08b143a341b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.188252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a1c8e-dfe2-4a31-b2a9-f08b143a341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.219424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-fe5a1c8e-dfe2-4a31-b2a9-f08b143a341b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:36.221582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-fe5a1c8e-dfe2-4a31-b2a9-f08b143a341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:36.338525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 947/1888] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:36.344569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bc126-3b52-4ef0-a795-e4badcf85405 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.344569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bc126-3b52-4ef0-a795-e4badcf85405 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.344569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bc126-3b52-4ef0-a795-e4badcf85405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.367209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-390bc126-3b52-4ef0-a795-e4badcf85405 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:36.368805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-390bc126-3b52-4ef0-a795-e4badcf85405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:36.383566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a1c8e-dfe2-4a31-b2a9-f08b143a341b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:36.384054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 942/1889] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:36.395499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a1c8e-dfe2-4a31-b2a9-f08b143a341b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:36.401005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:36.401974 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.402516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.402766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.403554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:36.404818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:36.406432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:36.427016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bc126-3b52-4ef0-a795-e4badcf85405 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:36.436446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 948/1890] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:36.438032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:36.439869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:36.448255 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bc126-3b52-4ef0-a795-e4badcf85405 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:36.463265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:36.464023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.465825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.466122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.468288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:36.470320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:36.477257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1746ed-06f9-4737-96f7-93ff28dad1a0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:36.491473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:36.492341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.492631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.492997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] PATH_INFO: `/v3/users/db513b63adc14f8fb725183909b09d5f` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.495638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db513b63adc14f8fb725183909b09d5f)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:36.499672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:36.532156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 943/1891] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:36 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:36.533770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:36.613736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db513b63adc14f8fb725183909b09d5f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.627163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db513b63adc14f8fb725183909b09d5f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.628124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db513b63adc14f8fb725183909b09d5f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.630452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db513b63adc14f8fb725183909b09d5f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.647534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9d8fbf44-b8e3-47e3-8182-9111e0820b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db513b63adc14f8fb725183909b09d5f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:36.666440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 949/1892] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:36 2022] DELETE /identity/v3/users/db513b63adc14f8fb725183909b09d5f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:36.671992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.672465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.672872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.710594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63766d-255f-4763-8ce8-6dbb0dd59f1f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:36.735622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:36.737618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:36.824911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 950/1893] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:36.873715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:36.874419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:36.875165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:36.875464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:36.876149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:36.878119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:36.884317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:36.885471 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:36.936136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 944/1894] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:36 2022] POST /identity/v3/users => generated 283 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:36.938202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:36.944916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:36.980613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6099dd9-262b-4cc4-be25-21c144033a79 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.005544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.006178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.006390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.006775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.007513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.009444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:37.049794 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 945/1895] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:37.050001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78baa4b6-dece-4fdd-9fbb-7ae181b60d53 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.050930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.056470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.057064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.057356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.057644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.077802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.079332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:37.080459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a3899-6ffe-4422-9622-9cad3bdad13f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.096145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af67861-ce77-4e36-afb1-65dac725a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.097008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 951/1896] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:37.100040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67861-ce77-4e36-afb1-65dac725a8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.100353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67861-ce77-4e36-afb1-65dac725a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.103715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67861-ce77-4e36-afb1-65dac725a8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.104590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af67861-ce77-4e36-afb1-65dac725a8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.107845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af67861-ce77-4e36-afb1-65dac725a8d5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:37.136152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 946/1897] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:37.140276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.150559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd6a7a-08cd-405d-b4ba-740f46390e81 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.164582 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.167277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.168470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.170483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] PATH_INFO: `/v3/projects/755ea62b93b241d3a3e39335790826eb/users/0de47a31fe0c49e9a06d7b96fe905c7e/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.230685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=755ea62b93b241d3a3e39335790826eb, user_id=0de47a31fe0c49e9a06d7b96fe905c7e, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.233891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:37.270003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 952/1898] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:37 2022] PUT /identity/v3/projects/755ea62b93b241d3a3e39335790826eb/users/0de47a31fe0c49e9a06d7b96fe905c7e/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:37.286418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8736a3f-a59f-45d1-8740-b775b77416d8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.286613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8736a3f-a59f-45d1-8740-b775b77416d8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.286852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8736a3f-a59f-45d1-8740-b775b77416d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.365472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b8736a3f-a59f-45d1-8740-b775b77416d8 None None] MFA Rules not processed for user `0de47a31fe0c49e9a06d7b96fe905c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:37.366719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b8736a3f-a59f-45d1-8740-b775b77416d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:37.541655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 947/1899] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:37.546648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.667903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20f2b6-4258-4beb-af0b-598dcbbff7eb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.676815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.678734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.679468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.680054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.681879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.685991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:37.726885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 953/1900] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:37 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:37.730801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8736a3f-a59f-45d1-8740-b775b77416d8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.745073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8736a3f-a59f-45d1-8740-b775b77416d8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.858142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.860392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.861549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.861744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.865487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.865487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:37.922514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 948/1901] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:37 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:37.926566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:37.945403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a29712-a277-4e86-aadf-0607f3edcaa6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:37.964157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:37.964772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:37.965060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:37.965345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:37.966062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:37.971624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.007382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.010157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 954/1902] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:38.021358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6c1b3-c409-4d24-be73-df8b279be376 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.038671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.039763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.040230 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.040681 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] PATH_INFO: `/v3/projects/01d672912e2a43f0a95e8b25902507bb/users/b0d044493b2f4c32b1c5bcf4b7080d40/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.082244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d672912e2a43f0a95e8b25902507bb, user_id=b0d044493b2f4c32b1c5bcf4b7080d40, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.085289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.106288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 949/1903] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:38 2022] PUT /identity/v3/projects/01d672912e2a43f0a95e8b25902507bb/users/b0d044493b2f4c32b1c5bcf4b7080d40/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:38.111511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.122612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fad40d-3274-4d35-9f62-99e78ab677ca admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.173880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.176131 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.286281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.286281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.287026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.287413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.288395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.290307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.305432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 955/1904] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:38.310597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.319766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692dde-9c30-4087-859c-a29e5eaf8564 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.322682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b027869-5cd9-4ae0-add1-741c29d5218e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.328076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.329003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a741e9e-3635-481d-a5c5-ef64d95a03bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.329151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.329502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.329851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] PATH_INFO: `/v3/projects/a2e3b2b95b6b4e69918aae4ad67d8e4e` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.330697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741e9e-3635-481d-a5c5-ef64d95a03bf admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.330996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741e9e-3635-481d-a5c5-ef64d95a03bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.331556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a741e9e-3635-481d-a5c5-ef64d95a03bf admin admin] PATH_INFO: `/v3/projects/01d672912e2a43f0a95e8b25902507bb/users/b0d044493b2f4c32b1c5bcf4b7080d40/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.331661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e3b2b95b6b4e69918aae4ad67d8e4e)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.333462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741e9e-3635-481d-a5c5-ef64d95a03bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d672912e2a43f0a95e8b25902507bb, user_id=b0d044493b2f4c32b1c5bcf4b7080d40, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.334178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.336305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a741e9e-3635-481d-a5c5-ef64d95a03bf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.360701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 956/1905] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:38 2022] PUT /identity/v3/projects/01d672912e2a43f0a95e8b25902507bb/users/b0d044493b2f4c32b1c5bcf4b7080d40/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:38.363553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.363852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.365745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.420873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] MFA Rules not processed for user `b0d044493b2f4c32b1c5bcf4b7080d40`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:38.422442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.443866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e3b2b95b6b4e69918aae4ad67d8e4e', 'request_id': 'req-64f2d213-5aaa-486c-b946-a0ba3cbe2911'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.452773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e3b2b95b6b4e69918aae4ad67d8e4e', 'request_id': 'req-64f2d213-5aaa-486c-b946-a0ba3cbe2911'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.468695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e3b2b95b6b4e69918aae4ad67d8e4e', 'request_id': 'req-64f2d213-5aaa-486c-b946-a0ba3cbe2911'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.503872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] The token cache is being invalidate because project a2e3b2b95b6b4e69918aae4ad67d8e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:38.504265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.504997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-64f2d213-5aaa-486c-b946-a0ba3cbe2911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:38.507197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 950/1906] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:38 2022] DELETE /identity/v3/projects/a2e3b2b95b6b4e69918aae4ad67d8e4e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:38.514167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9b281-0a7a-4d04-97a5-dfcc918fbce6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.514649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9b281-0a7a-4d04-97a5-dfcc918fbce6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.514951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9b281-0a7a-4d04-97a5-dfcc918fbce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.552423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 957/1907] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:38.563480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.565535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-cab9b281-0a7a-4d04-97a5-dfcc918fbce6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:38.565943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.566887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-cab9b281-0a7a-4d04-97a5-dfcc918fbce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.676333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62decc9-b1d2-4cd2-941d-85b95a3f3471 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.676423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 951/1908] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:38.682465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a710-c889-439c-a879-bb2c3aa6546b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.682765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a710-c889-439c-a879-bb2c3aa6546b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.683051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70a710-c889-439c-a879-bb2c3aa6546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.684586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.685707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.686029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.686314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.707783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.710657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.722995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 958/1909] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:38 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:38.739417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7e70a710-c889-439c-a879-bb2c3aa6546b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:38.740627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7e70a710-c889-439c-a879-bb2c3aa6546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:38.765415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 952/1910] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:38.770344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.806289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd1fd1-fa7f-4db9-99d3-ae52013aa113 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.811565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.812216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.812516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.812797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.813495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:38.813803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.815401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.836533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 959/1911] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:38.837543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70a710-c889-439c-a879-bb2c3aa6546b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.850682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70a710-c889-439c-a879-bb2c3aa6546b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.859300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.860044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.860368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.860699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.861467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:38.863692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:38.903682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 953/1912] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:38.907712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.913103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:38.928837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d96a-c8cd-4d19-9720-fc59da0e706a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.990217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe45d7-c795-4e60-babf-526645f3452c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:38.994220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:38.994974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:38.995265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:38.995599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:38.998738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:39.048174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.049049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.049407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.049640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.050274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.052240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:39.069567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.071789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:39.074662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 960/1913] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:38 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:39.078985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.082231 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 954/1914] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:38 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:39.088207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf883ef-0755-45b4-8f5a-c67e945abc6b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.093403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.094004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.094295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.094578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.095475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.097100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:39.110657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 961/1915] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:39.115285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.126591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbf5bb-81d6-43f4-b3b0-5df04a69d812 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.131575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17503fb7-7e3d-43c4-aa50-7c5fb5e9fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.132415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503fb7-7e3d-43c4-aa50-7c5fb5e9fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.132704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503fb7-7e3d-43c4-aa50-7c5fb5e9fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.132991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17503fb7-7e3d-43c4-aa50-7c5fb5e9fd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.133691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17503fb7-7e3d-43c4-aa50-7c5fb5e9fd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.135299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17503fb7-7e3d-43c4-aa50-7c5fb5e9fd3b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:39.146195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 955/1916] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:39.150598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.161196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8c766-7bab-4319-81de-2d9473c665ef admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.165489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.166296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.166588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.166871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] PATH_INFO: `/v3/projects/d107cb8af6ba4ec1a0ed81b5f0b808b2/users/bf87a5923272441896b3309563346485/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.187027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d107cb8af6ba4ec1a0ed81b5f0b808b2, user_id=bf87a5923272441896b3309563346485, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.189702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:39.203004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 962/1917] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:39 2022] PUT /identity/v3/projects/d107cb8af6ba4ec1a0ed81b5f0b808b2/users/bf87a5923272441896b3309563346485/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:39.213179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.213491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.213785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.258541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] MFA Rules not processed for user `bf87a5923272441896b3309563346485`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:39.259717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:39.337378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 956/1918] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:39 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:39.512628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:39.586908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dec84-15d3-45a5-923e-4f9821c0e657 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:39.590420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc635c1b-9fec-49b5-941c-a8e5bfae500a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:39.591078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc635c1b-9fec-49b5-941c-a8e5bfae500a service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:39.591466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc635c1b-9fec-49b5-941c-a8e5bfae500a service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:39.591767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc635c1b-9fec-49b5-941c-a8e5bfae500a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:39.600415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc635c1b-9fec-49b5-941c-a8e5bfae500a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:39.601849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc635c1b-9fec-49b5-941c-a8e5bfae500a service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:39.610412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 963/1919] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:39 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:40.173436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.176325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:40.286716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede6441-e1c5-4c30-8586-a422fed1fbb2 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.293669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:40.294546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.294979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.295457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] PATH_INFO: `/v3/users/269cad5784a347689e154ca5d3c5d45d` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.296608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269cad5784a347689e154ca5d3c5d45d)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:40.298568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:40.346612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269cad5784a347689e154ca5d3c5d45d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.347283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269cad5784a347689e154ca5d3c5d45d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.359000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269cad5784a347689e154ca5d3c5d45d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.359566 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269cad5784a347689e154ca5d3c5d45d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.366919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269cad5784a347689e154ca5d3c5d45d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:40.379693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 957/1920] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:40 2022] DELETE /identity/v3/users/269cad5784a347689e154ca5d3c5d45d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:40.384140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.384437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.384720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.407735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:40.408917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:40.475143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 964/1921] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:40.487447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:40.489245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:40.553264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffe143-b452-4226-974e-a2a54aea9197 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:40.556872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:40.557469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:40.557765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:40.558053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:40.567628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:40.569110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:40.579281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 958/1922] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:41.081091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.082523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:41.094810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1774cb-8100-4e92-ac93-3856e3f4a277 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.099500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.100395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.100689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.100976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] PATH_INFO: `/v3/projects/e11e6ea2acee4c9db5fcd9f3e9d2cc89` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.103188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11e6ea2acee4c9db5fcd9f3e9d2cc89)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.104950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:41.193163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11e6ea2acee4c9db5fcd9f3e9d2cc89', 'request_id': 'req-656a256c-1f6f-4fb6-8960-b294292ea04d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.212360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11e6ea2acee4c9db5fcd9f3e9d2cc89', 'request_id': 'req-656a256c-1f6f-4fb6-8960-b294292ea04d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.253222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11e6ea2acee4c9db5fcd9f3e9d2cc89', 'request_id': 'req-656a256c-1f6f-4fb6-8960-b294292ea04d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.276350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] The token cache is being invalidate because project e11e6ea2acee4c9db5fcd9f3e9d2cc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:41.276664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.277327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.283487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 965/1923] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:41 2022] DELETE /identity/v3/projects/e11e6ea2acee4c9db5fcd9f3e9d2cc89 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:41.287589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:41.300417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3985825-3805-415d-b601-0ca4ed37383d service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:41.464343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:41.465295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:41.465659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:41.466023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] PATH_INFO: `/v3/users/9c49285324de4713ae9582e6aee008eb` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:41.469369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c49285324de4713ae9582e6aee008eb)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:41.480932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:41.646821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c49285324de4713ae9582e6aee008eb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.648403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c49285324de4713ae9582e6aee008eb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.701459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c49285324de4713ae9582e6aee008eb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.702827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c49285324de4713ae9582e6aee008eb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.722653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-70239e89-9917-4742-bb6a-753ec83cd6a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c49285324de4713ae9582e6aee008eb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:41.745204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 959/1924] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:41 2022] DELETE /identity/v3/users/9c49285324de4713ae9582e6aee008eb => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:42.672528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:42.674198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:42.690333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a256c-1f6f-4fb6-8960-b294292ea04d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:42.763888 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:42.764741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:42.765032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:42.765317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] PATH_INFO: `/v3/projects/0752b9f2719c48889fd5569ffb9666bf` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:42.766467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0752b9f2719c48889fd5569ffb9666bf)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:42.768453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:42.839342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0752b9f2719c48889fd5569ffb9666bf', 'request_id': 'req-fbf4eba9-0d50-4ae9-8193-64f134504ec8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:42.849163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0752b9f2719c48889fd5569ffb9666bf', 'request_id': 'req-fbf4eba9-0d50-4ae9-8193-64f134504ec8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:42.863538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0752b9f2719c48889fd5569ffb9666bf', 'request_id': 'req-fbf4eba9-0d50-4ae9-8193-64f134504ec8'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:42.886436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] The token cache is being invalidate because project 0752b9f2719c48889fd5569ffb9666bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:42.887008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:42.887875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fbf4eba9-0d50-4ae9-8193-64f134504ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:42.891136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 966/1925] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:42 2022] DELETE /identity/v3/projects/0752b9f2719c48889fd5569ffb9666bf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:42.896629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cc13-fc87-42b2-bfb7-8a0c2e42b8e3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:42.897811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cc13-fc87-42b2-bfb7-8a0c2e42b8e3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:42.898694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8cc13-fc87-42b2-bfb7-8a0c2e42b8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:42.933542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b4c8cc13-fc87-42b2-bfb7-8a0c2e42b8e3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:42.935110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b4c8cc13-fc87-42b2-bfb7-8a0c2e42b8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:43.024733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 960/1926] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:43.024947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b9dd7-25d2-46cf-a0f0-21de90199f09 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.025346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b9dd7-25d2-46cf-a0f0-21de90199f09 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.025476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b9dd7-25d2-46cf-a0f0-21de90199f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.070328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-378b9dd7-25d2-46cf-a0f0-21de90199f09 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:43.071558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-378b9dd7-25d2-46cf-a0f0-21de90199f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:43.081096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 967/1927] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:43.085041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8cc13-fc87-42b2-bfb7-8a0c2e42b8e3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.095426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8cc13-fc87-42b2-bfb7-8a0c2e42b8e3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.100551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.101154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.101661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.102127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.102819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:43.103444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.105179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.121162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 961/1928] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:43.125909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b9dd7-25d2-46cf-a0f0-21de90199f09 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.136165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b9dd7-25d2-46cf-a0f0-21de90199f09 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.142265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.143064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.143353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.143637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.152125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.173586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.200631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 968/1929] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:43 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:43.204869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.220183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d907-26b0-48fb-88fb-479a6d884917 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.313861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.314473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.314765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.315057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.315711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.317696 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.344112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 962/1930] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:43 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:44:43.347534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.360446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3099bce-d255-4b2b-bc99-cd29b6208913 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.367344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.367344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.367344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.367344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.368425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.369735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.382975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 969/1931] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:43.388253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.422132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d5d30-fba6-4515-8605-b0383d6540ff admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.426922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2109f0f-eacb-4726-8afe-80fc7917fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.427781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2109f0f-eacb-4726-8afe-80fc7917fbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.428122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2109f0f-eacb-4726-8afe-80fc7917fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.428414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2109f0f-eacb-4726-8afe-80fc7917fbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.429135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2109f0f-eacb-4726-8afe-80fc7917fbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.430760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2109f0f-eacb-4726-8afe-80fc7917fbf8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.463219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 963/1932] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:43.467446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.479636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caf6a3-ee7d-44ca-9cc4-07c016ea6702 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.496829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.497799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.498167 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.498408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] PATH_INFO: `/v3/projects/e6797adfb92944e9902881e73a08884f/users/0d85b29f66f84796b0205f2fc0c4021b/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.532396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6797adfb92944e9902881e73a08884f, user_id=0d85b29f66f84796b0205f2fc0c4021b, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.535218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.565520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 970/1933] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:43 2022] PUT /identity/v3/projects/e6797adfb92944e9902881e73a08884f/users/0d85b29f66f84796b0205f2fc0c4021b/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:43.577133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ae68-0a0b-448a-8347-9b22c7a08963 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.577440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ae68-0a0b-448a-8347-9b22c7a08963 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.577737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ae68-0a0b-448a-8347-9b22c7a08963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.639727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-aed4ae68-0a0b-448a-8347-9b22c7a08963 None None] MFA Rules not processed for user `0d85b29f66f84796b0205f2fc0c4021b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:43.643063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-aed4ae68-0a0b-448a-8347-9b22c7a08963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:43.758408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.760876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 964/1934] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:43 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:43.841654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44065bb5-50e7-4bcb-bbb8-644ab6998ac6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.846315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.846904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.847197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.847486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.848198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.850093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.891146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 971/1935] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:43 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:43.892213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ae68-0a0b-448a-8347-9b22c7a08963 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:43.903029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ae68-0a0b-448a-8347-9b22c7a08963 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:43.972629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:43.973273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:43.973633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:43.973991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:43.974702 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:43.976721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:43.995439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 965/1936] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:43 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:44.000507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.010392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ab1d-bb9f-4deb-bb19-816f8c4a3efb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.015474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.016219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.016494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.016852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.017647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.019359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:44.031380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 972/1937] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:44.036127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.047261 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7d816-9e10-4d4d-bfc8-ff4240246da5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.052114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.053646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.053944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.054232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] PATH_INFO: `/v3/projects/90136330bef64b418d7100093458f783/users/89572e3c83704033b2087fc3ffc259c1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.077876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90136330bef64b418d7100093458f783, user_id=89572e3c83704033b2087fc3ffc259c1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.081081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:44.105651 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 966/1938] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:44 2022] PUT /identity/v3/projects/90136330bef64b418d7100093458f783/users/89572e3c83704033b2087fc3ffc259c1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:44.110543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.127790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbada6-6a1b-41f6-82fc-df7b77cbd2d3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.213603 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d91b43-b822-4da4-abc3-22ee2222b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.214212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91b43-b822-4da4-abc3-22ee2222b5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.214508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91b43-b822-4da4-abc3-22ee2222b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.214798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d91b43-b822-4da4-abc3-22ee2222b5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.215506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d91b43-b822-4da4-abc3-22ee2222b5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.217671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d91b43-b822-4da4-abc3-22ee2222b5a1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:44.228368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 973/1939] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:44.232610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.246415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c32d16-10e6-4631-937c-5763834d1fc1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.251478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.252348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.252644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.252958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] PATH_INFO: `/v3/projects/90136330bef64b418d7100093458f783/users/89572e3c83704033b2087fc3ffc259c1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.254856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90136330bef64b418d7100093458f783, user_id=89572e3c83704033b2087fc3ffc259c1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.257518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:44.270064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 967/1940] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:44 2022] PUT /identity/v3/projects/90136330bef64b418d7100093458f783/users/89572e3c83704033b2087fc3ffc259c1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:44.280742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f0637-747a-4dd4-87dd-5b9216e3967f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.281052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f0637-747a-4dd4-87dd-5b9216e3967f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.281346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f0637-747a-4dd4-87dd-5b9216e3967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.338276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-945f0637-747a-4dd4-87dd-5b9216e3967f None None] MFA Rules not processed for user `89572e3c83704033b2087fc3ffc259c1`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:44.341825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-945f0637-747a-4dd4-87dd-5b9216e3967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:44.465287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 974/1941] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:44 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:44.478711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.481341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:44.570016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463a6c7-83ca-4292-bd19-00e185adb8f4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.573710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d543d9-e8ab-4811-b105-923b17c7c103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.574457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d543d9-e8ab-4811-b105-923b17c7c103 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.574856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d543d9-e8ab-4811-b105-923b17c7c103 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.577284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d543d9-e8ab-4811-b105-923b17c7c103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.586720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d543d9-e8ab-4811-b105-923b17c7c103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.588300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d543d9-e8ab-4811-b105-923b17c7c103 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:44.597870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 968/1942] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:44 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:44:44.722711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f0637-747a-4dd4-87dd-5b9216e3967f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:44.806450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f0637-747a-4dd4-87dd-5b9216e3967f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:44.812406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:44.813681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.814200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.814685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] PATH_INFO: `/v3/users/0d85b29f66f84796b0205f2fc0c4021b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.816513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d85b29f66f84796b0205f2fc0c4021b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:44.818875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:44.893821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d85b29f66f84796b0205f2fc0c4021b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:44.901685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d85b29f66f84796b0205f2fc0c4021b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:44.902636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d85b29f66f84796b0205f2fc0c4021b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:44.903392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d85b29f66f84796b0205f2fc0c4021b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:44.920378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d85b29f66f84796b0205f2fc0c4021b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:44.935465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 975/1943] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:44 2022] DELETE /identity/v3/users/0d85b29f66f84796b0205f2fc0c4021b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:44.940301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:44.942081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:44.942619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:44.975953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:44.977416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.049636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 969/1944] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:45.060908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:45.062404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.128767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d9f2d-1fbc-42cb-b126-03afe321ee0f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:45.135381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79f5d7-fe61-4cd8-ac61-35bac20f10e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:45.136073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f5d7-fe61-4cd8-ac61-35bac20f10e5 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:45.136468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f5d7-fe61-4cd8-ac61-35bac20f10e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:45.136651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79f5d7-fe61-4cd8-ac61-35bac20f10e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:45.147628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79f5d7-fe61-4cd8-ac61-35bac20f10e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:45.149130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79f5d7-fe61-4cd8-ac61-35bac20f10e5 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:45.158683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 976/1945] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:45.239206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:45.243154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.276348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158338fc-e04e-4126-a90f-24ecba2ad6fb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:45.282842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:45.283680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:45.283984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:45.284269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] PATH_INFO: `/v3/users/0de47a31fe0c49e9a06d7b96fe905c7e` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:45.285790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de47a31fe0c49e9a06d7b96fe905c7e)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:45.291330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:45.378121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de47a31fe0c49e9a06d7b96fe905c7e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.378924 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de47a31fe0c49e9a06d7b96fe905c7e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.403121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de47a31fe0c49e9a06d7b96fe905c7e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.405201 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de47a31fe0c49e9a06d7b96fe905c7e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.414454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de47a31fe0c49e9a06d7b96fe905c7e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.432069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 970/1946] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:45 2022] DELETE /identity/v3/users/0de47a31fe0c49e9a06d7b96fe905c7e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:45.433596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:45.434402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:45.434402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:45.477025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:45.478430 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.588075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 977/1947] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:44:45.595288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:45.596975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.735116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fd22a-de52-411d-aead-4b951b9a1938 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:45.740657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:45.741571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:45.741869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:45.742165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:45.753251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:45.754692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:45.769372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 971/1948] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:45.816325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:45.821633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:45.847589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac10d4-d07d-48fe-a155-f084d9a6939c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:45.853015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:45.853918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:45.854284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:45.854664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] PATH_INFO: `/v3/projects/e6797adfb92944e9902881e73a08884f` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:45.856162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6797adfb92944e9902881e73a08884f)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:45.859384 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:45.925607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6797adfb92944e9902881e73a08884f', 'request_id': 'req-61a21131-9e2c-4072-a301-4b6d3c651a14'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.936650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6797adfb92944e9902881e73a08884f', 'request_id': 'req-61a21131-9e2c-4072-a301-4b6d3c651a14'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.952456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6797adfb92944e9902881e73a08884f', 'request_id': 'req-61a21131-9e2c-4072-a301-4b6d3c651a14'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.964787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] The token cache is being invalidate because project e6797adfb92944e9902881e73a08884f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:45.965381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.966768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:45.968894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 978/1949] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:45 2022] DELETE /identity/v3/projects/e6797adfb92944e9902881e73a08884f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:45.973726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:45.987099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90448b13-eece-490f-ae78-d598c6781185 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:46.077688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:46.078642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:46.079016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:46.079682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] PATH_INFO: `/v3/users/89572e3c83704033b2087fc3ffc259c1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:46.081066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89572e3c83704033b2087fc3ffc259c1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:46.083180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:46.146267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89572e3c83704033b2087fc3ffc259c1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.147028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89572e3c83704033b2087fc3ffc259c1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.173312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89572e3c83704033b2087fc3ffc259c1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.174354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89572e3c83704033b2087fc3ffc259c1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.192792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89572e3c83704033b2087fc3ffc259c1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.221248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 972/1950] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:45 2022] DELETE /identity/v3/users/89572e3c83704033b2087fc3ffc259c1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:46.652090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:46.653667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:46.673081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a21131-9e2c-4072-a301-4b6d3c651a14 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:46.798596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:46.799532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:46.799648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:46.800006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] PATH_INFO: `/v3/projects/755ea62b93b241d3a3e39335790826eb` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:46.801231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755ea62b93b241d3a3e39335790826eb)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:46.803503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:46.862035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755ea62b93b241d3a3e39335790826eb', 'request_id': 'req-c67814a1-c2da-4ce2-93ee-4102190d5683'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.870774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755ea62b93b241d3a3e39335790826eb', 'request_id': 'req-c67814a1-c2da-4ce2-93ee-4102190d5683'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.885615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755ea62b93b241d3a3e39335790826eb', 'request_id': 'req-c67814a1-c2da-4ce2-93ee-4102190d5683'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.899513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] The token cache is being invalidate because project 755ea62b93b241d3a3e39335790826eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:46.900018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.900835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:46.902732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 979/1951] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:46 2022] DELETE /identity/v3/projects/755ea62b93b241d3a3e39335790826eb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:46.907069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:46.908515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:46.924368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214e35-a7b6-4c3e-b050-cce92d159d2b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:47.002254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:47.003162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.003516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.003863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] PATH_INFO: `/v3/users/b0d044493b2f4c32b1c5bcf4b7080d40` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.005280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d044493b2f4c32b1c5bcf4b7080d40)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:47.007404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:47.081718 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d044493b2f4c32b1c5bcf4b7080d40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.083236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d044493b2f4c32b1c5bcf4b7080d40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.114021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d044493b2f4c32b1c5bcf4b7080d40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.116006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d044493b2f4c32b1c5bcf4b7080d40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.135097 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-39b7612f-c55b-406d-b0be-27d735a2e59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d044493b2f4c32b1c5bcf4b7080d40'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.163200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 973/1952] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:44:46 2022] DELETE /identity/v3/users/b0d044493b2f4c32b1c5bcf4b7080d40 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:47.168671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:47.171357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:47.234287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67814a1-c2da-4ce2-93ee-4102190d5683 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:47.389370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:47.390334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.390722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.391103 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] PATH_INFO: `/v3/projects/90136330bef64b418d7100093458f783` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.394136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90136330bef64b418d7100093458f783)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:47.396853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:47.514959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90136330bef64b418d7100093458f783', 'request_id': 'req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.533456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90136330bef64b418d7100093458f783', 'request_id': 'req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.554164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90136330bef64b418d7100093458f783', 'request_id': 'req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.572093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] The token cache is being invalidate because project 90136330bef64b418d7100093458f783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:47.572395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.573077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a9d8fce-2746-42fb-8ab6-c09a58a9b335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:47.574798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 980/1953] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:47 2022] DELETE /identity/v3/projects/90136330bef64b418d7100093458f783 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:47.579934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941392c1-80f5-438d-9f74-b269378c66c6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.580252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941392c1-80f5-438d-9f74-b269378c66c6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.580588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941392c1-80f5-438d-9f74-b269378c66c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.613022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-941392c1-80f5-438d-9f74-b269378c66c6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:47.614586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-941392c1-80f5-438d-9f74-b269378c66c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:47.699098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 974/1954] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:47.702078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85885e-a1e2-49a5-8576-2bec4e207c17 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.702380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85885e-a1e2-49a5-8576-2bec4e207c17 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.702698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85885e-a1e2-49a5-8576-2bec4e207c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.737084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-3c85885e-a1e2-49a5-8576-2bec4e207c17 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:47.738277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3c85885e-a1e2-49a5-8576-2bec4e207c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:47.751953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 981/1955] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:47.753347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941392c1-80f5-438d-9f74-b269378c66c6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:47.764594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941392c1-80f5-438d-9f74-b269378c66c6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:47.770420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:47.771387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.771824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.772398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.773263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:47.773713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:47.777615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:47.803468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 975/1956] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:44:47.808678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85885e-a1e2-49a5-8576-2bec4e207c17 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:47.820728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85885e-a1e2-49a5-8576-2bec4e207c17 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:47.828100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:47.829070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:47.829551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:47.830058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:47.830894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:47.833175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:47.874732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 982/1957] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:47 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:47.879106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:47.892129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330647a4-c3e9-470b-846e-2525c8903f7f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:48.022686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:48.024195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.024664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.025109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.025855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:48.027783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:48.114285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:48.114734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 976/1958] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:47 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:48.128997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25526d25-20c4-4bf6-a4a3-a351f51cd545 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:48.134388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:48.135247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.135760 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.136303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.137220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:48.141050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:48.160331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 983/1959] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:48.161815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:48.183765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cf394-03ec-4bdf-9b16-fcffd2da0c72 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:48.200747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eeea60-bb71-4f4b-a7ee-c9c36b248fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:48.201595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeea60-bb71-4f4b-a7ee-c9c36b248fcc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.202684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeea60-bb71-4f4b-a7ee-c9c36b248fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.202845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eeea60-bb71-4f4b-a7ee-c9c36b248fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.203501 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eeea60-bb71-4f4b-a7ee-c9c36b248fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:48.208668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eeea60-bb71-4f4b-a7ee-c9c36b248fcc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:48.240083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 977/1960] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:48.241946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:48.262638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c0467-9294-4502-838b-6f651b06161c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:48.269335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:48.270436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.271097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.271847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] PATH_INFO: `/v3/projects/55f71ed63ab545b4a52d0a3d8595797c/users/93817a58756242f5b051f3481952fc4d/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.300741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f71ed63ab545b4a52d0a3d8595797c, user_id=93817a58756242f5b051f3481952fc4d, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:48.304024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:48.351120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 984/1961] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:48 2022] PUT /identity/v3/projects/55f71ed63ab545b4a52d0a3d8595797c/users/93817a58756242f5b051f3481952fc4d/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:48.352758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.353131 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.353417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.396204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] MFA Rules not processed for user `93817a58756242f5b051f3481952fc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:48.397854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:48.514946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 978/1962] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:48 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:48.527332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:48.529893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:48.650000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefac13-27ea-4f94-9895-c04dc39ad176 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:48.654460 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d9b49-949d-415e-9d72-984dd9797fe5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:48.655060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d9b49-949d-415e-9d72-984dd9797fe5 service glance] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.655354 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d9b49-949d-415e-9d72-984dd9797fe5 service glance] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.655644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d9b49-949d-415e-9d72-984dd9797fe5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.665572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d9b49-949d-415e-9d72-984dd9797fe5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:48.667633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d9b49-949d-415e-9d72-984dd9797fe5 service glance] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:48.679433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 985/1963] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:48 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:44:48.739553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:48.740954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:48.897410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e0e32-9cc1-42e5-8236-b2b42555c1e7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:48.911498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:48.912241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:48.912625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:48.912918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] PATH_INFO: `/v3/projects/01d672912e2a43f0a95e8b25902507bb` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:48.916470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d672912e2a43f0a95e8b25902507bb)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:48.918406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:49.090559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d672912e2a43f0a95e8b25902507bb', 'request_id': 'req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:49.096732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d672912e2a43f0a95e8b25902507bb', 'request_id': 'req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:49.122809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d672912e2a43f0a95e8b25902507bb', 'request_id': 'req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:49.151667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] The token cache is being invalidate because project 01d672912e2a43f0a95e8b25902507bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:44:49.152627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:49.154270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b8d43dad-838d-4ee2-a9b4-4137eb8192fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:44:49.157908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 979/1964] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:44:48 2022] DELETE /identity/v3/projects/01d672912e2a43f0a95e8b25902507bb => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:49.162804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cec63-d5cc-4d1e-9de9-9bde06a34ff3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:49.163332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cec63-d5cc-4d1e-9de9-9bde06a34ff3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:49.163411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cec63-d5cc-4d1e-9de9-9bde06a34ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:49.209506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1e9cec63-d5cc-4d1e-9de9-9bde06a34ff3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:49.220157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1e9cec63-d5cc-4d1e-9de9-9bde06a34ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:49.359346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 986/1965] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:49.367893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2afe-5ff5-4f1e-b010-fd50ad0cea5b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:49.367893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2afe-5ff5-4f1e-b010-fd50ad0cea5b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:49.368185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad2afe-5ff5-4f1e-b010-fd50ad0cea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:49.416025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b0ad2afe-5ff5-4f1e-b010-fd50ad0cea5b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:49.418009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b0ad2afe-5ff5-4f1e-b010-fd50ad0cea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:49.439966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cec63-d5cc-4d1e-9de9-9bde06a34ff3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:49.454001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 980/1966] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:49.456685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cec63-d5cc-4d1e-9de9-9bde06a34ff3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:49.484644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:49.486305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:49.487496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:49.488211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:49.489971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:44:49.491396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:49.495446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:49.539767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad2afe-5ff5-4f1e-b010-fd50ad0cea5b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:49.562299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 987/1967] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:44:49.563828 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad2afe-5ff5-4f1e-b010-fd50ad0cea5b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:49.574611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:49.575721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:49.576100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:49.576381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:49.577306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:49.584209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:49.654822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:49.660711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 981/1968] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:49 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:49.671180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05019c73-30bf-47ab-aeb5-743b02478247 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:49.919843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:49.920513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:49.920810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:49.924069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:49.924877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:49.927330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:49.978432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 988/1969] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:49 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:49.982631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:49.994657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760d2b8-b12a-4f74-b070-d1854bd4c3a2 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.011218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.015290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.017901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.018838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.020464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.022348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:50.056645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 982/1970] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:50.061066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.074065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2b55d-41ff-4a8a-978d-0f9a003789bd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.080639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189be0a3-6b6f-4c1d-8d36-2697789e57d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.080918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be0a3-6b6f-4c1d-8d36-2697789e57d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.081223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be0a3-6b6f-4c1d-8d36-2697789e57d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.081569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189be0a3-6b6f-4c1d-8d36-2697789e57d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.082323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189be0a3-6b6f-4c1d-8d36-2697789e57d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.084072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189be0a3-6b6f-4c1d-8d36-2697789e57d5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:50.096920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 989/1971] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:50.100675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.112371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50edb87-b5ab-4388-8351-e3135a846b61 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.117640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.118676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.119267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.119720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] PATH_INFO: `/v3/projects/3dea93aa5803489aa36a0369eecc3e96/users/94d9299d4d264ce7bfc1e51ca6716135/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.141688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dea93aa5803489aa36a0369eecc3e96, user_id=94d9299d4d264ce7bfc1e51ca6716135, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.144935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:50.166636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 983/1972] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:50 2022] PUT /identity/v3/projects/3dea93aa5803489aa36a0369eecc3e96/users/94d9299d4d264ce7bfc1e51ca6716135/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:50.178154 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a5be-38ca-454e-89f2-c149b0e9c1ba None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.179337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a5be-38ca-454e-89f2-c149b0e9c1ba None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.179893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478a5be-38ca-454e-89f2-c149b0e9c1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.265663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-3478a5be-38ca-454e-89f2-c149b0e9c1ba None None] MFA Rules not processed for user `94d9299d4d264ce7bfc1e51ca6716135`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:50.266885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3478a5be-38ca-454e-89f2-c149b0e9c1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:50.368315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 990/1973] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:50.372358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.577742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32182e-2c48-4fe5-8ce8-14d8cb7667d0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.588606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.589233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.589526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.590017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.590655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.593034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:50.655056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 984/1974] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:44:50 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:50.656294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478a5be-38ca-454e-89f2-c149b0e9c1ba None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.666774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478a5be-38ca-454e-89f2-c149b0e9c1ba None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.828557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.829186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.829485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.829794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.830545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.832629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:50.868716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 991/1975] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:44:50 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:44:50.873502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.896496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b45f3-c2f4-4929-abad-c87606af3ba1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:50.919112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:50.920022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:50.920470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:50.920940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:50.921821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:50.923584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:50.963091 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 985/1976] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:44:50.968583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:50.991417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f205b-5ebb-4bf7-94d6-5a336590d716 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:51.021283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:51.022138 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:51.022437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:51.022817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] PATH_INFO: `/v3/projects/d62f264592684e99942e5e54fddb555f/users/dccb263a15b84d148fb4c15769f868bd/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:51.074494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62f264592684e99942e5e54fddb555f, user_id=dccb263a15b84d148fb4c15769f868bd, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:51.077903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:51.103027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 992/1977] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:50 2022] PUT /identity/v3/projects/d62f264592684e99942e5e54fddb555f/users/dccb263a15b84d148fb4c15769f868bd/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:44:51.107762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:51.118069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339d14-07ea-4acd-8024-9cc9e45413d5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:51.258434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1986d91-ff69-4cad-9c59-8699b454522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:51.259061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986d91-ff69-4cad-9c59-8699b454522c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:51.259351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986d91-ff69-4cad-9c59-8699b454522c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:51.259642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986d91-ff69-4cad-9c59-8699b454522c admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:51.260435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1986d91-ff69-4cad-9c59-8699b454522c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:51.263439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1986d91-ff69-4cad-9c59-8699b454522c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:51.287347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 986/1978] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:44:51.288577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:51.305672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0dcb3-ab16-40ec-84c4-1d305ed6d422 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:51.316302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:51.317142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:51.319952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:51.320260 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] PATH_INFO: `/v3/projects/d62f264592684e99942e5e54fddb555f/users/dccb263a15b84d148fb4c15769f868bd/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:51.322208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62f264592684e99942e5e54fddb555f, user_id=dccb263a15b84d148fb4c15769f868bd, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:51.326172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:51.344548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 993/1979] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:44:51 2022] PUT /identity/v3/projects/d62f264592684e99942e5e54fddb555f/users/dccb263a15b84d148fb4c15769f868bd/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:44:51.354588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36718f7e-a0d7-4518-b441-baa70025267f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:51.354888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36718f7e-a0d7-4518-b441-baa70025267f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:51.355182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36718f7e-a0d7-4518-b441-baa70025267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:51.402277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-36718f7e-a0d7-4518-b441-baa70025267f None None] MFA Rules not processed for user `dccb263a15b84d148fb4c15769f868bd`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:44:51.404005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-36718f7e-a0d7-4518-b441-baa70025267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:51.553001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 987/1980] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:44:51 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:44:51.564142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:44:51.566101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:44:51.696082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b4ce0-05d8-4477-834d-84df1539f370 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:44:51.700410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:44:51.701285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:44:51.703064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:44:51.703460 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:44:51.784876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:44:51.786804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:44:51.797167 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 994/1981] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:44:51 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:10.907763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36718f7e-a0d7-4518-b441-baa70025267f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:10.930768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36718f7e-a0d7-4518-b441-baa70025267f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:10.934341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:10.935551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:10.935999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:10.936289 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:10.966553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:10.968058 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:10.977904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 988/1982] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:10 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:13.600622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:13.602239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:13.749276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7de2a-fd4d-458e-ad39-df7a10c799c2 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:13.754918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c09762-b068-4470-9658-6390424f05de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:13.756214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09762-b068-4470-9658-6390424f05de admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:13.758101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09762-b068-4470-9658-6390424f05de admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:13.758405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09762-b068-4470-9658-6390424f05de admin admin] PATH_INFO: `/v3/users/f6ebb03a3a3f4e8cbc996251a4fefb8e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:13.759727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c09762-b068-4470-9658-6390424f05de admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ebb03a3a3f4e8cbc996251a4fefb8e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:13.761845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c09762-b068-4470-9658-6390424f05de admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:13.823201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-87c09762-b068-4470-9658-6390424f05de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ebb03a3a3f4e8cbc996251a4fefb8e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.833748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-87c09762-b068-4470-9658-6390424f05de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ebb03a3a3f4e8cbc996251a4fefb8e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.834378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-87c09762-b068-4470-9658-6390424f05de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ebb03a3a3f4e8cbc996251a4fefb8e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.834991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-87c09762-b068-4470-9658-6390424f05de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ebb03a3a3f4e8cbc996251a4fefb8e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.860998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-87c09762-b068-4470-9658-6390424f05de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ebb03a3a3f4e8cbc996251a4fefb8e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:13.880630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 995/1983] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:13 2022] DELETE /identity/v3/users/f6ebb03a3a3f4e8cbc996251a4fefb8e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:14.153852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.166065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf41ae-903a-4749-8062-277dd28082c1 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.248711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.249873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.250495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.250940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] PATH_INFO: `/v3/projects/a7827966303d4944b40900c83b7d40b9` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.252507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7827966303d4944b40900c83b7d40b9)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.254752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:14.313344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7827966303d4944b40900c83b7d40b9', 'request_id': 'req-b1044fb5-4090-4114-9735-df13e0ebac56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.319114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7827966303d4944b40900c83b7d40b9', 'request_id': 'req-b1044fb5-4090-4114-9735-df13e0ebac56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.327167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7827966303d4944b40900c83b7d40b9', 'request_id': 'req-b1044fb5-4090-4114-9735-df13e0ebac56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.345591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] The token cache is being invalidate because project a7827966303d4944b40900c83b7d40b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:14.345885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.346522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b1044fb5-4090-4114-9735-df13e0ebac56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:14.347997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 989/1984] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:14 2022] DELETE /identity/v3/projects/a7827966303d4944b40900c83b7d40b9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:14.353202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29378d1-f815-4a55-8381-42d7014f17f0 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.353606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29378d1-f815-4a55-8381-42d7014f17f0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.353957 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29378d1-f815-4a55-8381-42d7014f17f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.423718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e29378d1-f815-4a55-8381-42d7014f17f0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:14.425277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e29378d1-f815-4a55-8381-42d7014f17f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:14.509719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 996/1985] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:14.517800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9ba6-f3f2-43a7-bb43-55d561fc9de1 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.518102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9ba6-f3f2-43a7-bb43-55d561fc9de1 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.518394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9ba6-f3f2-43a7-bb43-55d561fc9de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.546713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-3dce9ba6-f3f2-43a7-bb43-55d561fc9de1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:14.547903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-3dce9ba6-f3f2-43a7-bb43-55d561fc9de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:14.556215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 990/1986] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:14.561793 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29378d1-f815-4a55-8381-42d7014f17f0 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.572505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29378d1-f815-4a55-8381-42d7014f17f0 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.577845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.578470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.578729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.579022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.579723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:45:14.580089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.581883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:14.595649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 997/1987] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:14.600393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce9ba6-f3f2-43a7-bb43-55d561fc9de1 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.610146 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce9ba6-f3f2-43a7-bb43-55d561fc9de1 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.614562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.615158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.615448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.615734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.616420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.618306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:14.647402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 991/1988] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:14.650652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.661253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104257cc-71d2-4b87-8457-f9b1586dc94e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.740612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.741224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.741513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.741798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.742436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.744402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:14.768467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 998/1989] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:14.772036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.791455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f6626-7afe-4188-8c8a-31f158b38abb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.796633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.797499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.797853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.798211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.798942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.800583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:14.811314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 992/1990] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:14.815648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.826929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac8b15-9e96-45a3-b727-bdddef810772 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.831666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc110c5-834d-438e-a4c6-35ad2beb69b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.832507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc110c5-834d-438e-a4c6-35ad2beb69b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.832833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc110c5-834d-438e-a4c6-35ad2beb69b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.833118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc110c5-834d-438e-a4c6-35ad2beb69b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.834120 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc110c5-834d-438e-a4c6-35ad2beb69b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.835828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc110c5-834d-438e-a4c6-35ad2beb69b2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:14.849684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 999/1991] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:14.852560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:14.863337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9d498-94ca-4ea4-96d7-c34d8a0146a3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:14.868466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:14.869434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.869731 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.870021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] PATH_INFO: `/v3/projects/bd1b3bd04ce44cd7893a53eb18d9a8b0/users/b3cc30404a3c4a16aff55c90e698e489/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.890343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1b3bd04ce44cd7893a53eb18d9a8b0, user_id=b3cc30404a3c4a16aff55c90e698e489, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:14.893210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:14.906296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 993/1992] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:14 2022] PUT /identity/v3/projects/bd1b3bd04ce44cd7893a53eb18d9a8b0/users/b3cc30404a3c4a16aff55c90e698e489/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:14.912279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:14.912576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:14.912865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:14.936889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:14.938125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:15.002829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1000/1993] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:15.013867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:15.015402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:15.133022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816825d5-0a6b-4240-a3e7-01488847dfc1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:15.136551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471f73-b432-47bf-bbbe-ebe77d04a276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:15.137134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471f73-b432-47bf-bbbe-ebe77d04a276 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:15.137424 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471f73-b432-47bf-bbbe-ebe77d04a276 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:15.138269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471f73-b432-47bf-bbbe-ebe77d04a276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:15.147733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471f73-b432-47bf-bbbe-ebe77d04a276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:15.149211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471f73-b432-47bf-bbbe-ebe77d04a276 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:15.160047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 994/1994] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:17.553865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.555373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:17.567375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4c316-30eb-45c2-82f0-845846884726 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.571822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.572764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.573126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.573480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] PATH_INFO: `/v3/users/94d9299d4d264ce7bfc1e51ca6716135` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.574682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d9299d4d264ce7bfc1e51ca6716135)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.576798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:17.636300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d9299d4d264ce7bfc1e51ca6716135'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:17.644848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d9299d4d264ce7bfc1e51ca6716135'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:17.645612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d9299d4d264ce7bfc1e51ca6716135'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:17.646213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d9299d4d264ce7bfc1e51ca6716135'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:17.660248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d9299d4d264ce7bfc1e51ca6716135'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:17.675774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1001/1995] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:17 2022] DELETE /identity/v3/users/94d9299d4d264ce7bfc1e51ca6716135 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:17.682409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.683460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.683754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.706368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:17.707542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:17.775906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 995/1996] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:17.784429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:17.785770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:17.866696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81d2b9-524b-4bc5-bd5c-1d1985e934b9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:17.870496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:17.871195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:17.871590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:17.872118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:17.882452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:17.884075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:17.894664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1002/1997] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:18.664528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:18.667216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:18.691247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0750e76-ac1e-491e-b1f8-2dbf46dd4df8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:18.697348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:18.698414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:18.698938 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:18.699686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] PATH_INFO: `/v3/projects/3dea93aa5803489aa36a0369eecc3e96` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:18.703280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dea93aa5803489aa36a0369eecc3e96)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:18.705748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:18.771277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dea93aa5803489aa36a0369eecc3e96', 'request_id': 'req-0506fabf-a617-4851-a0ed-b9117ce3a50c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:18.776800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dea93aa5803489aa36a0369eecc3e96', 'request_id': 'req-0506fabf-a617-4851-a0ed-b9117ce3a50c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:18.787901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dea93aa5803489aa36a0369eecc3e96', 'request_id': 'req-0506fabf-a617-4851-a0ed-b9117ce3a50c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:18.811680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] The token cache is being invalidate because project 3dea93aa5803489aa36a0369eecc3e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:18.812078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:18.814658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:18.816689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 996/1998] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:18 2022] DELETE /identity/v3/projects/3dea93aa5803489aa36a0369eecc3e96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:18.828612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:18.838448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19423b-3ee9-4363-a54c-6d25679a2291 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:18.932125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:18.933425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:18.933947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:18.934577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] PATH_INFO: `/v3/users/dccb263a15b84d148fb4c15769f868bd` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:18.936079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dccb263a15b84d148fb4c15769f868bd)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:18.942416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:19.014850 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dccb263a15b84d148fb4c15769f868bd'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.027070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dccb263a15b84d148fb4c15769f868bd'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.028875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dccb263a15b84d148fb4c15769f868bd'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.029713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dccb263a15b84d148fb4c15769f868bd'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.053935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-117bfb25-f9e8-4019-b256-69d580966530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dccb263a15b84d148fb4c15769f868bd'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.074232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1003/1999] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:18 2022] DELETE /identity/v3/users/dccb263a15b84d148fb4c15769f868bd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:19.524055 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:19.525733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:19.560795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506fabf-a617-4851-a0ed-b9117ce3a50c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:19.630587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:19.631390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:19.631714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:19.632063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] PATH_INFO: `/v3/projects/d62f264592684e99942e5e54fddb555f` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:19.633196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62f264592684e99942e5e54fddb555f)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:19.635106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:19.690292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62f264592684e99942e5e54fddb555f', 'request_id': 'req-2bfe14a9-365c-4f40-8158-828f4b220fb6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.697656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62f264592684e99942e5e54fddb555f', 'request_id': 'req-2bfe14a9-365c-4f40-8158-828f4b220fb6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.707585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62f264592684e99942e5e54fddb555f', 'request_id': 'req-2bfe14a9-365c-4f40-8158-828f4b220fb6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.728642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] The token cache is being invalidate because project d62f264592684e99942e5e54fddb555f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:19.728929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.729774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bfe14a9-365c-4f40-8158-828f4b220fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:19.731539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 997/2000] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:19 2022] DELETE /identity/v3/projects/d62f264592684e99942e5e54fddb555f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:19.737542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443588b-b784-4e31-9e38-6e7301d96393 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:19.737838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443588b-b784-4e31-9e38-6e7301d96393 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:19.738520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443588b-b784-4e31-9e38-6e7301d96393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:19.762007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-9443588b-b784-4e31-9e38-6e7301d96393 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:19.764617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9443588b-b784-4e31-9e38-6e7301d96393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:19.835943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1004/2001] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:19.846073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3408a-53ed-47bc-b7d9-bc4dffb1ba51 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:19.846700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3408a-53ed-47bc-b7d9-bc4dffb1ba51 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:19.847047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3408a-53ed-47bc-b7d9-bc4dffb1ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:19.869801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6bb3408a-53ed-47bc-b7d9-bc4dffb1ba51 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:19.871040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6bb3408a-53ed-47bc-b7d9-bc4dffb1ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:19.879674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 998/2002] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:19.884135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443588b-b784-4e31-9e38-6e7301d96393 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:19.896211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443588b-b784-4e31-9e38-6e7301d96393 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:19.901879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:19.902477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:19.902775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:19.903714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:19.904552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:45:19.904867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:19.906650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:19.920482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1005/2003] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:45:19.924816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3408a-53ed-47bc-b7d9-bc4dffb1ba51 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:19.933720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3408a-53ed-47bc-b7d9-bc4dffb1ba51 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:19.939364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:19.939881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:19.940211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:19.940557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:19.941152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:19.943160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:19.975827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 999/2004] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:19 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:19.977014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:19.988347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d061f-0af5-4825-aed2-c438ce238210 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:20.059255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:20.060641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.060955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.061241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.061910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:20.063822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:20.085000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1006/2005] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:19 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:20.089030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:20.101569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a54cdc-858e-425d-b9a1-98f843d9294c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:20.106946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:20.107558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.107859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.108183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.108882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:20.110504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:20.121293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1000/2006] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:20.125742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:20.137680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9642fb-c8e0-4dad-b380-996a615ead3e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:20.145245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70cfae7-ccb8-44a7-9e26-2143bc84ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:20.145852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfae7-ccb8-44a7-9e26-2143bc84ea55 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.146395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfae7-ccb8-44a7-9e26-2143bc84ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.146395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70cfae7-ccb8-44a7-9e26-2143bc84ea55 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.147119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cfae7-ccb8-44a7-9e26-2143bc84ea55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:20.149464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70cfae7-ccb8-44a7-9e26-2143bc84ea55 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:20.162788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1007/2007] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:20.167096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:20.180544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88897265-896d-46c8-b1eb-e921b44788bf admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:20.186173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:20.187066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.187301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.187587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] PATH_INFO: `/v3/projects/cc9029c662454065b723fbc909c1a182/users/e61cda9d1bf24b1880ea415bfeddb8dc/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.213940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9029c662454065b723fbc909c1a182, user_id=e61cda9d1bf24b1880ea415bfeddb8dc, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:20.216893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:20.233068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1001/2008] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:20 2022] PUT /identity/v3/projects/cc9029c662454065b723fbc909c1a182/users/e61cda9d1bf24b1880ea415bfeddb8dc/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:20.245315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60ace4-c9d9-436c-90da-741a37078fe7 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.246079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60ace4-c9d9-436c-90da-741a37078fe7 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.246808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60ace4-c9d9-436c-90da-741a37078fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.310962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-0c60ace4-c9d9-436c-90da-741a37078fe7 None None] MFA Rules not processed for user `e61cda9d1bf24b1880ea415bfeddb8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:20.312674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0c60ace4-c9d9-436c-90da-741a37078fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:20.454830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1008/2009] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:20 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:20.465196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:20.467458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:20.594380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55095-6cbc-4e52-a205-513e308e91d3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:20.606763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca7c97-1470-419b-af88-a8bd765f7cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:20.607205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7c97-1470-419b-af88-a8bd765f7cfe service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.607503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7c97-1470-419b-af88-a8bd765f7cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.607794 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca7c97-1470-419b-af88-a8bd765f7cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.631602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca7c97-1470-419b-af88-a8bd765f7cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:20.633516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca7c97-1470-419b-af88-a8bd765f7cfe service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:20.648729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1002/2010] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:20 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:20.670907 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60ace4-c9d9-436c-90da-741a37078fe7 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:20.754097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60ace4-c9d9-436c-90da-741a37078fe7 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:20.759775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:20.760660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.761003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.761653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] PATH_INFO: `/v3/users/e61cda9d1bf24b1880ea415bfeddb8dc` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.764349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61cda9d1bf24b1880ea415bfeddb8dc)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:20.768429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:20.834648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61cda9d1bf24b1880ea415bfeddb8dc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:20.844269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61cda9d1bf24b1880ea415bfeddb8dc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:20.844998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61cda9d1bf24b1880ea415bfeddb8dc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:20.845744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61cda9d1bf24b1880ea415bfeddb8dc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:20.860008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61cda9d1bf24b1880ea415bfeddb8dc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:20.875994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1009/2011] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:20 2022] DELETE /identity/v3/users/e61cda9d1bf24b1880ea415bfeddb8dc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:20.880160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:20.880663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:20.880747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:20.914543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:20.916247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:20.994606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1003/2012] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:21.005879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:21.007427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:21.088441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8170-3435-4a27-83d6-5d650540b10d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:21.092680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7fd54-9e59-4a97-860c-7fb22a10fd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:21.093355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7fd54-9e59-4a97-860c-7fb22a10fd9a service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.093720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7fd54-9e59-4a97-860c-7fb22a10fd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.094146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7fd54-9e59-4a97-860c-7fb22a10fd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.105473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7fd54-9e59-4a97-860c-7fb22a10fd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:21.107579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7fd54-9e59-4a97-860c-7fb22a10fd9a service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:21.120775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1010/2013] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:45:21.629001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:21.635096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:21.659176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae847c7-ec5b-4442-afb9-f04a83c1af33 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:21.663830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:21.664746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.665105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.665460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] PATH_INFO: `/v3/projects/cc9029c662454065b723fbc909c1a182` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.666735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9029c662454065b723fbc909c1a182)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:21.668836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:21.709811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f249-5093-4a8b-9f28-a49d1f12b121 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.710110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f249-5093-4a8b-9f28-a49d1f12b121 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.710423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f249-5093-4a8b-9f28-a49d1f12b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.727645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9029c662454065b723fbc909c1a182', 'request_id': 'req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:21.736568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9029c662454065b723fbc909c1a182', 'request_id': 'req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:21.745429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9029c662454065b723fbc909c1a182', 'request_id': 'req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:21.749442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8091f249-5093-4a8b-9f28-a49d1f12b121 None None] MFA Rules not processed for user `b3cc30404a3c4a16aff55c90e698e489`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:21.750649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8091f249-5093-4a8b-9f28-a49d1f12b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:21.765405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] The token cache is being invalidate because project cc9029c662454065b723fbc909c1a182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:21.765710 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:21.766499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-68813c2a-e0c8-471d-843e-dc3eed3b3cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:21.768398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1004/2014] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:21 2022] DELETE /identity/v3/projects/cc9029c662454065b723fbc909c1a182 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:21.773643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964b2e0-4c08-4f8a-9cb9-74f1d22d13d7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.774057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964b2e0-4c08-4f8a-9cb9-74f1d22d13d7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.774411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964b2e0-4c08-4f8a-9cb9-74f1d22d13d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.799142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f964b2e0-4c08-4f8a-9cb9-74f1d22d13d7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:21.800714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f964b2e0-4c08-4f8a-9cb9-74f1d22d13d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:21.836767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1011/2015] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:21 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:21.847571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.848256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.848352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.873492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] MFA Rules not processed for user `b3cc30404a3c4a16aff55c90e698e489`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:21.874673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:21.877641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1005/2016] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:21.881087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1012/2017] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:21 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:21.885138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90440946-2b3c-4724-bff8-dcd9f2366804 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.885577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90440946-2b3c-4724-bff8-dcd9f2366804 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.885726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90440946-2b3c-4724-bff8-dcd9f2366804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.891504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:21.893045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:21.908339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-90440946-2b3c-4724-bff8-dcd9f2366804 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:21.909527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-90440946-2b3c-4724-bff8-dcd9f2366804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:21.917409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1006/2018] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:21.922227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90440946-2b3c-4724-bff8-dcd9f2366804 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:21.931495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90440946-2b3c-4724-bff8-dcd9f2366804 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:21.937226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:21.937826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.938128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.938612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.939316 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:45:21.939624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:21.941359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:21.956480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1007/2019] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:45:21.960861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:21.971413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1e6b-4609-46a6-87c9-36747d71caea admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:21.976103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:21.976697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.976994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.977282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.977922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:21.979139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11f5e-d2b9-47be-9b24-91585e279cbb None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:21.979859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:21.985110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:21.985696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:21.985981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:21.986263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:21.994264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:21.995768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.006157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1013/2020] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:21 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:45:22.008640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1008/2021] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:21 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:22.013152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.022960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31013fca-1fb1-4383-a4c6-655a3fda3ee2 service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.088927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.089531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.089821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.090105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.091457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.093418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.117797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1014/2022] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:22 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:22.118983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.129249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be37bbc-82a7-47cc-9ca9-56225c6e0a6f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.134284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.135015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.135185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.135474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.136253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.137906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.149221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1009/2023] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:22.154075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.164337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef1957-596c-40c0-8027-bbcf86e15b34 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.169633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359d9fb-bef7-403d-bb6d-c5646d63ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.170252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359d9fb-bef7-403d-bb6d-c5646d63ef17 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.170525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359d9fb-bef7-403d-bb6d-c5646d63ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.170815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359d9fb-bef7-403d-bb6d-c5646d63ef17 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.171530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359d9fb-bef7-403d-bb6d-c5646d63ef17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.174069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359d9fb-bef7-403d-bb6d-c5646d63ef17 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.186804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1015/2024] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:22.191193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.201429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26524-b222-4f62-a6f1-a8a596f82544 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.206079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.206975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.207339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.207697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] PATH_INFO: `/v3/projects/548623d6ffeb41cda868cb56ab2df8e8/users/1f5011e980af48d3b651baf26ed29c14/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.228712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548623d6ffeb41cda868cb56ab2df8e8, user_id=1f5011e980af48d3b651baf26ed29c14, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.232166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.246282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1010/2025] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:22 2022] PUT /identity/v3/projects/548623d6ffeb41cda868cb56ab2df8e8/users/1f5011e980af48d3b651baf26ed29c14/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:22.257551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4433-9af5-4f32-aaf2-00d1bc990f2b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.257925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4433-9af5-4f32-aaf2-00d1bc990f2b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.258276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a4433-9af5-4f32-aaf2-00d1bc990f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.297341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2a4a4433-9af5-4f32-aaf2-00d1bc990f2b None None] MFA Rules not processed for user `1f5011e980af48d3b651baf26ed29c14`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:22.298510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2a4a4433-9af5-4f32-aaf2-00d1bc990f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:22.384057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1016/2026] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:22.389006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.497836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f525a-4674-4ae0-b964-3f043c101b45 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.513041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.513605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.513968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.514329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.515059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.517298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.566093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1011/2027] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:22 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:22.570132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4433-9af5-4f32-aaf2-00d1bc990f2b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.597813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a4433-9af5-4f32-aaf2-00d1bc990f2b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.688142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.688941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.689402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.689843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.690642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.692737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.721612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1017/2028] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:22 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:22.725469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.736716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226514fb-18c6-49fd-a8a2-3c184e160250 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.741186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.741857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.742219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.742576 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.743345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.745200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.759267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1012/2029] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:22.764268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.774153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77c904-35b9-4830-a9b3-cbb7b132a61f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.779918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e045b-8c6a-45b3-8639-d72f58103770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.780573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e045b-8c6a-45b3-8639-d72f58103770 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.780864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e045b-8c6a-45b3-8639-d72f58103770 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.781287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e045b-8c6a-45b3-8639-d72f58103770 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.781995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e045b-8c6a-45b3-8639-d72f58103770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.783587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e045b-8c6a-45b3-8639-d72f58103770 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.796153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1018/2030] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:22.800151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:22.812198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be44dc8-3529-4762-9e0c-4ac0503176aa admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:22.818088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:22.819008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.819190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.819481 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] PATH_INFO: `/v3/projects/980954227f4345eaa7ed1858afd6c634/users/f24cef7037954853a5e928ea4fec7895/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.841536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=980954227f4345eaa7ed1858afd6c634, user_id=f24cef7037954853a5e928ea4fec7895, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:22.844232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:22.858754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1013/2031] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:22 2022] PUT /identity/v3/projects/980954227f4345eaa7ed1858afd6c634/users/f24cef7037954853a5e928ea4fec7895/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:22.869117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aae2eb-8277-4e1f-907e-b3341546adf2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:22.869630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aae2eb-8277-4e1f-907e-b3341546adf2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:22.869727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aae2eb-8277-4e1f-907e-b3341546adf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:22.909280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c1aae2eb-8277-4e1f-907e-b3341546adf2 None None] MFA Rules not processed for user `f24cef7037954853a5e928ea4fec7895`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:22.910469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c1aae2eb-8277-4e1f-907e-b3341546adf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:23.002988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1019/2032] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:23.007453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:23.115763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e572a-b11a-4366-add2-6d99b190e99a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.116400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e572a-b11a-4366-add2-6d99b190e99a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.116990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e572a-b11a-4366-add2-6d99b190e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.133500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab3688-2c11-4632-afba-b446700195cb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:23.139821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:23.140316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5c3e572a-b11a-4366-add2-6d99b190e99a None None] MFA Rules not processed for user `b3cc30404a3c4a16aff55c90e698e489`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:23.140824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.141125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.141539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.142208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:23.142338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5c3e572a-b11a-4366-add2-6d99b190e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:23.144586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:23.191595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1014/2033] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:23 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:23.192596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:23.223306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1020/2034] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:23.284203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180a8fe-69ce-41f6-8609-be0e5b423e0c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:23.291407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:23.291952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.292427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.292871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.295153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:23.297516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:23.324721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1015/2035] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:23 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:23.330837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e572a-b11a-4366-add2-6d99b190e99a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:23.346110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e572a-b11a-4366-add2-6d99b190e99a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:23.351464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:23.352224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.352646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.352935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.353784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:23.355550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:23.372181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1021/2036] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:23.376215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:23.388919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3238f-4ada-4040-a67b-1f77b0f6205f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:23.397758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:23.398822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.399113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.399456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] PATH_INFO: `/v3/projects/6668c6ad39a042a5a985701f75076011/users/3e08e8386fe24a18b133e52d1d48df25/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.423593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6668c6ad39a042a5a985701f75076011, user_id=3e08e8386fe24a18b133e52d1d48df25, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:23.427026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:23.452070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1016/2037] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:23 2022] PUT /identity/v3/projects/6668c6ad39a042a5a985701f75076011/users/3e08e8386fe24a18b133e52d1d48df25/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:23.453397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:23.466752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8c868-0f2e-4be7-9d16-d7606a54c956 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:23.553640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e792c-5229-4116-8a8f-93b76065c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:23.554262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e792c-5229-4116-8a8f-93b76065c4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.554611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e792c-5229-4116-8a8f-93b76065c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.554904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e792c-5229-4116-8a8f-93b76065c4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.555610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e792c-5229-4116-8a8f-93b76065c4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:23.557293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e792c-5229-4116-8a8f-93b76065c4e9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:23.572021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1022/2038] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:23.574241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:23.586351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f886fd-50e1-468c-acd3-579429a6c38f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:23.591915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:23.592774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.593070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.593442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] PATH_INFO: `/v3/projects/6668c6ad39a042a5a985701f75076011/users/3e08e8386fe24a18b133e52d1d48df25/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.596194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6668c6ad39a042a5a985701f75076011, user_id=3e08e8386fe24a18b133e52d1d48df25, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:23.598883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:23.610468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1017/2039] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:23 2022] PUT /identity/v3/projects/6668c6ad39a042a5a985701f75076011/users/3e08e8386fe24a18b133e52d1d48df25/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:23.621949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5532fe-d762-4ce2-aa36-0e9d8e33b42d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.622362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5532fe-d762-4ce2-aa36-0e9d8e33b42d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.622741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5532fe-d762-4ce2-aa36-0e9d8e33b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.687895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6a5532fe-d762-4ce2-aa36-0e9d8e33b42d None None] MFA Rules not processed for user `3e08e8386fe24a18b133e52d1d48df25`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:23.689984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6a5532fe-d762-4ce2-aa36-0e9d8e33b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:23.817173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1023/2040] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:23.828257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:23.830098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:23.904488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c234ca4-c687-4442-98aa-c003de57e162 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:23.908381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:23.909167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:23.909633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:23.910076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:23.984270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:23.985919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:24.008394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1018/2041] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:23 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:26.239486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5532fe-d762-4ce2-aa36-0e9d8e33b42d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:26.253087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5532fe-d762-4ce2-aa36-0e9d8e33b42d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:26.267286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:26.268030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:26.268403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:26.269821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:26.385459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:26.387044 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:26.398353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1024/2042] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:26 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:27.718802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:27.720353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:27.738636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cddcbb-1fa0-4f19-af5c-a138c31e1391 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:27.747752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33e152-2458-48d9-92db-3cf0526b9375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:27.748605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33e152-2458-48d9-92db-3cf0526b9375 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:27.749002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33e152-2458-48d9-92db-3cf0526b9375 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:27.753390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33e152-2458-48d9-92db-3cf0526b9375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:27.774466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33e152-2458-48d9-92db-3cf0526b9375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:27.776330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33e152-2458-48d9-92db-3cf0526b9375 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:27.789007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1019/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:27 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:30.133696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.135035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.214443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e20498-7f1d-4648-a072-384f9f8dcecc service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.219021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.219821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.220155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.220441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] PATH_INFO: `/v3/users/3e89ef8773e64a02befec8fe8cfcd9b6` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.221561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e89ef8773e64a02befec8fe8cfcd9b6)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.223889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:30.276077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e89ef8773e64a02befec8fe8cfcd9b6'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:30.286156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e89ef8773e64a02befec8fe8cfcd9b6'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:30.291447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e89ef8773e64a02befec8fe8cfcd9b6'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:30.291447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e89ef8773e64a02befec8fe8cfcd9b6'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:30.308501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e89ef8773e64a02befec8fe8cfcd9b6'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:30.323083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1025/2044] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:30 2022] DELETE /identity/v3/users/3e89ef8773e64a02befec8fe8cfcd9b6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:30.327573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.328059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.328337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.350846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:30.352101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.421206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1020/2045] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:30.431523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:30.432861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:30.538930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93abf09-c5ec-4d85-a71e-de02528888ca admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:30.542329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:30.542910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:30.543231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:30.543910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:30.555630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:30.557145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:30.569977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1026/2046] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:31.158700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:31.160156 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:31.171830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126f804-fe2c-44a2-80ba-de7a6546a753 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:31.176578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:31.177753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:31.178140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:31.178530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] PATH_INFO: `/v3/projects/832dc1bab8ce473c826397776a85bb82` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:31.179816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832dc1bab8ce473c826397776a85bb82)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:31.182025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:31.234210 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832dc1bab8ce473c826397776a85bb82', 'request_id': 'req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.240370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832dc1bab8ce473c826397776a85bb82', 'request_id': 'req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.250594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832dc1bab8ce473c826397776a85bb82', 'request_id': 'req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.267788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] The token cache is being invalidate because project 832dc1bab8ce473c826397776a85bb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:31.268111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.268764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.270278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1021/2047] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:31 2022] DELETE /identity/v3/projects/832dc1bab8ce473c826397776a85bb82 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:31.274146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:31.283523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105742f-c899-46cf-9a77-0f795d2ef62e service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:31.350981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:31.351783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:31.352111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:31.352404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] PATH_INFO: `/v3/users/50c16e15d4eb47888df03b55b6f869d4` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:31.353557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c16e15d4eb47888df03b55b6f869d4)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:31.355489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:31.408580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c16e15d4eb47888df03b55b6f869d4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.417169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c16e15d4eb47888df03b55b6f869d4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.418482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c16e15d4eb47888df03b55b6f869d4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.419691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c16e15d4eb47888df03b55b6f869d4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.432854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-7faa39e3-b3da-4eae-a9ab-1cac96ac779a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c16e15d4eb47888df03b55b6f869d4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:31.452028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1027/2048] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:31 2022] DELETE /identity/v3/users/50c16e15d4eb47888df03b55b6f869d4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:31.929263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:31.930713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:31.945405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60c78b-19a8-4635-bb4c-eb8e50bd8b85 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.024010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.024817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.025103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.025381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] PATH_INFO: `/v3/projects/f2f51a2d4f9f4ba7abf3e6cf377b5784` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.026512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f51a2d4f9f4ba7abf3e6cf377b5784)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.028972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.083076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f51a2d4f9f4ba7abf3e6cf377b5784', 'request_id': 'req-32590c08-e5df-4ac6-99f0-e7a5d81833b9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.090937 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f51a2d4f9f4ba7abf3e6cf377b5784', 'request_id': 'req-32590c08-e5df-4ac6-99f0-e7a5d81833b9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.098930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f51a2d4f9f4ba7abf3e6cf377b5784', 'request_id': 'req-32590c08-e5df-4ac6-99f0-e7a5d81833b9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.117758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] The token cache is being invalidate because project f2f51a2d4f9f4ba7abf3e6cf377b5784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:32.118050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.118703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-32590c08-e5df-4ac6-99f0-e7a5d81833b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:32.120217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1022/2049] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:31 2022] DELETE /identity/v3/projects/f2f51a2d4f9f4ba7abf3e6cf377b5784 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:32.126183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff49a-de1e-4902-b945-ea6e90e0aa25 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.126559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff49a-de1e-4902-b945-ea6e90e0aa25 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.126908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff49a-de1e-4902-b945-ea6e90e0aa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.161940 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-cfcff49a-de1e-4902-b945-ea6e90e0aa25 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:32.163211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cfcff49a-de1e-4902-b945-ea6e90e0aa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:32.236581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1028/2050] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:32.244850 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f0edd-3e3e-4389-a71e-f4c58623351b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.245146 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f0edd-3e3e-4389-a71e-f4c58623351b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.245431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f0edd-3e3e-4389-a71e-f4c58623351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.269504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e82f0edd-3e3e-4389-a71e-f4c58623351b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:32.271307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e82f0edd-3e3e-4389-a71e-f4c58623351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:32.280336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1023/2051] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:32.284923 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff49a-de1e-4902-b945-ea6e90e0aa25 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.299073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff49a-de1e-4902-b945-ea6e90e0aa25 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.301982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.302830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.303124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.303495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.304162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:45:32.304496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.306078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.323075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1029/2052] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:45:32.328163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f0edd-3e3e-4389-a71e-f4c58623351b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.337174 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f0edd-3e3e-4389-a71e-f4c58623351b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.343851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.344711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.346540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.346833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.347494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.349429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.387975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1024/2053] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:32.390888 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.401444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cebd3-f77f-4689-916e-f9533be07262 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.473001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.473733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.473918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.474277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.474911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.477713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.509470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1030/2054] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:32.513720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.523757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377b5d3-84ad-416d-ac97-1743fa595c12 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.528504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.529102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.529393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.529672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.530384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.532038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.544239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1025/2055] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:32.546807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.557198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d9a78-7148-4aaf-85ff-ec2ae9497b6f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.564630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69dd1-91cd-4341-8ce3-44dcf4b62e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.565536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69dd1-91cd-4341-8ce3-44dcf4b62e91 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.566034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69dd1-91cd-4341-8ce3-44dcf4b62e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.566412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69dd1-91cd-4341-8ce3-44dcf4b62e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.567552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda69dd1-91cd-4341-8ce3-44dcf4b62e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.572156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda69dd1-91cd-4341-8ce3-44dcf4b62e91 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.582715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1031/2056] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:32.589065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.603640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96b305-ffd8-4465-84ba-9642afd0be33 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.609070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.609891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.610182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.610471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] PATH_INFO: `/v3/projects/c746000535844582b919aecb3d40cfb3/users/1b9f6f4bde6141d1ba2ccc3b6f16fbda/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.632582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c746000535844582b919aecb3d40cfb3, user_id=1b9f6f4bde6141d1ba2ccc3b6f16fbda, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.636423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.651574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1026/2057] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:32 2022] PUT /identity/v3/projects/c746000535844582b919aecb3d40cfb3/users/1b9f6f4bde6141d1ba2ccc3b6f16fbda/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:32.663126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e812-c31a-409c-a4ae-407735fb6621 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.663434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e812-c31a-409c-a4ae-407735fb6621 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.663722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e812-c31a-409c-a4ae-407735fb6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.706730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e991e812-c31a-409c-a4ae-407735fb6621 None None] MFA Rules not processed for user `1b9f6f4bde6141d1ba2ccc3b6f16fbda`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:32.708074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e991e812-c31a-409c-a4ae-407735fb6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:32.782947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1032/2058] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:32.787525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.861358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c7de3-abc8-426a-a1e2-20f3888f9022 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.866373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.867053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.867376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.867659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.868435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.870615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:32.904078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1027/2059] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:32.905565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e812-c31a-409c-a4ae-407735fb6621 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:32.917378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e812-c31a-409c-a4ae-407735fb6621 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:32.991236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:32.991844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:32.992163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:32.992446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:32.993088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:32.995016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:33.015784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1033/2060] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:32 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:45:33.019992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.030445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501bc5d-593d-48f0-a597-a4fe8cbddc0a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.034896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.035499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.035790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.036103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.036814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.038399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:33.050371 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1028/2061] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:33.054816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.064959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287957b4-417a-47bb-97ee-9ac753338288 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.069308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.070117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.070408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.070696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] PATH_INFO: `/v3/projects/c74a3fba72db4e6fac4fb28b976aa981/users/e731c8de043f419b9f0b3807e62fd6d9/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.091012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74a3fba72db4e6fac4fb28b976aa981, user_id=e731c8de043f419b9f0b3807e62fd6d9, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.093703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:33.107192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1034/2062] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:33 2022] PUT /identity/v3/projects/c74a3fba72db4e6fac4fb28b976aa981/users/e731c8de043f419b9f0b3807e62fd6d9/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:33.111445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.121180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae1b2-33f8-4899-a621-e3953672d509 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.186003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e8f1f-5682-42df-a9f1-4ebdd6a4efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.186520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8f1f-5682-42df-a9f1-4ebdd6a4efc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.186818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8f1f-5682-42df-a9f1-4ebdd6a4efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.187138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e8f1f-5682-42df-a9f1-4ebdd6a4efc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.187880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8f1f-5682-42df-a9f1-4ebdd6a4efc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.189552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e8f1f-5682-42df-a9f1-4ebdd6a4efc4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:33.199526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1029/2063] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:33.203723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.213626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d897fd-81cb-4aa0-8492-e356a49a72ba admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.218810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.219631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.219952 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.220240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] PATH_INFO: `/v3/projects/c74a3fba72db4e6fac4fb28b976aa981/users/e731c8de043f419b9f0b3807e62fd6d9/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.222107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74a3fba72db4e6fac4fb28b976aa981, user_id=e731c8de043f419b9f0b3807e62fd6d9, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.224804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:33.236015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1035/2064] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:33 2022] PUT /identity/v3/projects/c74a3fba72db4e6fac4fb28b976aa981/users/e731c8de043f419b9f0b3807e62fd6d9/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:33.249725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.250019 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.250319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.285986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] MFA Rules not processed for user `e731c8de043f419b9f0b3807e62fd6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:33.287160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:33.366209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1030/2065] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:33.376323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.377968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:33.445956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39b50d-6949-4557-a80b-c44632751418 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.449407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acaa1c-079b-4929-aa36-84d7410c3611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.449994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acaa1c-079b-4929-aa36-84d7410c3611 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.450284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acaa1c-079b-4929-aa36-84d7410c3611 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.450567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acaa1c-079b-4929-aa36-84d7410c3611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.514992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acaa1c-079b-4929-aa36-84d7410c3611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.516540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acaa1c-079b-4929-aa36-84d7410c3611 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:33.525845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1036/2066] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:33 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:33.752641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:33.754077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:33.839202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc7da-11cf-47e5-97e8-2c324605d9f4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:33.839603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:33.841567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.842089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.842408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] PATH_INFO: `/v3/users/1f5011e980af48d3b651baf26ed29c14` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.843846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5011e980af48d3b651baf26ed29c14)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:33.845815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:33.904399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5011e980af48d3b651baf26ed29c14'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.905117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5011e980af48d3b651baf26ed29c14'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.931436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5011e980af48d3b651baf26ed29c14'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.932450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5011e980af48d3b651baf26ed29c14'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.943395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5011e980af48d3b651baf26ed29c14'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:33.959885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1031/2067] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:33 2022] DELETE /identity/v3/users/1f5011e980af48d3b651baf26ed29c14 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:33.964484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:33.964780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:33.970372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:33.995488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:33.997695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.082152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1037/2068] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:34.092672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.094025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.159191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b082c-27e9-4c15-a28b-f27ec96e21a3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.162659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.163238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.163533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.163822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.173517 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.174944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:34.184305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1032/2069] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:34.558205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.560107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:34.571412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6105710-e611-45f4-aac1-26e6a16c1ce6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.576520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.577298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.577610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.577895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] PATH_INFO: `/v3/projects/548623d6ffeb41cda868cb56ab2df8e8` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.579022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=548623d6ffeb41cda868cb56ab2df8e8)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.580935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:34.638756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548623d6ffeb41cda868cb56ab2df8e8', 'request_id': 'req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.646417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548623d6ffeb41cda868cb56ab2df8e8', 'request_id': 'req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.660447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548623d6ffeb41cda868cb56ab2df8e8', 'request_id': 'req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.671026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] The token cache is being invalidate because project 548623d6ffeb41cda868cb56ab2df8e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:34.671308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.671984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.673436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1038/2070] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:34 2022] DELETE /identity/v3/projects/548623d6ffeb41cda868cb56ab2df8e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:34.677674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:34.687411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56359-5999-4807-ac27-76ab714cc24a service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:34.763393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:34.764335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:34.764635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:34.764922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] PATH_INFO: `/v3/users/f24cef7037954853a5e928ea4fec7895` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:34.766088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24cef7037954853a5e928ea4fec7895)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:34.768117 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:34.818868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24cef7037954853a5e928ea4fec7895'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.819536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24cef7037954853a5e928ea4fec7895'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.831666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24cef7037954853a5e928ea4fec7895'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.832707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24cef7037954853a5e928ea4fec7895'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.840744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24cef7037954853a5e928ea4fec7895'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:34.854726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1033/2071] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:34 2022] DELETE /identity/v3/users/f24cef7037954853a5e928ea4fec7895 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:35.285412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.286973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:35.299473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444a4cb-d910-4cf3-9d37-78b3e4cd72fc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.370034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.370845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.371137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.371407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] PATH_INFO: `/v3/projects/980954227f4345eaa7ed1858afd6c634` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.372676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=980954227f4345eaa7ed1858afd6c634)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.374597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:35.426639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980954227f4345eaa7ed1858afd6c634', 'request_id': 'req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.433539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980954227f4345eaa7ed1858afd6c634', 'request_id': 'req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.447056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980954227f4345eaa7ed1858afd6c634', 'request_id': 'req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.457552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] The token cache is being invalidate because project 980954227f4345eaa7ed1858afd6c634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:35.457841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.458500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.459956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1039/2072] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:35 2022] DELETE /identity/v3/projects/980954227f4345eaa7ed1858afd6c634 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:35.463733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:35.465774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:35.477971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d9044-4828-4a57-8558-4218ef6d9e8c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:35.548559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:35.549365 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:35.549659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:35.549948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] PATH_INFO: `/v3/users/3e08e8386fe24a18b133e52d1d48df25` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:35.551061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e08e8386fe24a18b133e52d1d48df25)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:35.553306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:35.606047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e08e8386fe24a18b133e52d1d48df25'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.606804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e08e8386fe24a18b133e52d1d48df25'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.618875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e08e8386fe24a18b133e52d1d48df25'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.619548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e08e8386fe24a18b133e52d1d48df25'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.628744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f8650e61-251d-418c-81af-d2a2fd867a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e08e8386fe24a18b133e52d1d48df25'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:35.642134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1034/2073] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:45:35 2022] DELETE /identity/v3/users/3e08e8386fe24a18b133e52d1d48df25 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:36.020397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.021798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.034279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81a6cc-0ffe-4b17-902a-deabd078dc0e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.099251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.100103 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.100398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.100691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] PATH_INFO: `/v3/projects/6668c6ad39a042a5a985701f75076011` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.101802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6668c6ad39a042a5a985701f75076011)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.103690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.153525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6668c6ad39a042a5a985701f75076011', 'request_id': 'req-5a7c815d-8934-4bad-b8d7-d06c8496f631'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.161813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6668c6ad39a042a5a985701f75076011', 'request_id': 'req-5a7c815d-8934-4bad-b8d7-d06c8496f631'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.175853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6668c6ad39a042a5a985701f75076011', 'request_id': 'req-5a7c815d-8934-4bad-b8d7-d06c8496f631'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.187102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] The token cache is being invalidate because project 6668c6ad39a042a5a985701f75076011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:45:36.187414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.188172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5a7c815d-8934-4bad-b8d7-d06c8496f631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:45:36.193449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1040/2074] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:45:36 2022] DELETE /identity/v3/projects/6668c6ad39a042a5a985701f75076011 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:45:36.194734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f271fd-41c3-48b3-8b14-78bd7edc436f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.195031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f271fd-41c3-48b3-8b14-78bd7edc436f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.195320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f271fd-41c3-48b3-8b14-78bd7edc436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.220288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b6f271fd-41c3-48b3-8b14-78bd7edc436f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:36.223387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b6f271fd-41c3-48b3-8b14-78bd7edc436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.293546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1035/2075] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:36.301301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967aac9-2560-462d-b8e0-31c07a46b908 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.301600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967aac9-2560-462d-b8e0-31c07a46b908 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.301889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967aac9-2560-462d-b8e0-31c07a46b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.325452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c967aac9-2560-462d-b8e0-31c07a46b908 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:36.326665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c967aac9-2560-462d-b8e0-31c07a46b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.334627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1041/2076] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:45:36.338715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f271fd-41c3-48b3-8b14-78bd7edc436f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.354271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f271fd-41c3-48b3-8b14-78bd7edc436f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.361526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.362072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.362380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.362663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.363327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:45:36.363630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.365260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.379113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1036/2077] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:45:36.383451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967aac9-2560-462d-b8e0-31c07a46b908 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.393630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967aac9-2560-462d-b8e0-31c07a46b908 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.398115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.398711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.399000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.399288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.400056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.401821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.430445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1042/2078] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:45:36 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:36.434759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.446400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa08c2-c161-42ea-9253-21feb022526a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.512686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.513323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.513579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.514151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.514510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.516448 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.539775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1037/2079] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:45:36 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:45:36.541044 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.551304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746d44-8040-461e-82d3-2db8f7cb0060 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.556731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.557338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.557631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.557914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.559648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.561290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.574567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1043/2080] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:45:36.576494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.586353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1b301-27b6-46a5-a2e0-4470356e347f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.591533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1696943-6b90-4f1d-babc-6898da27ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.592291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1696943-6b90-4f1d-babc-6898da27ad09 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.592581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1696943-6b90-4f1d-babc-6898da27ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.592872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1696943-6b90-4f1d-babc-6898da27ad09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.593581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1696943-6b90-4f1d-babc-6898da27ad09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.595286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1696943-6b90-4f1d-babc-6898da27ad09 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.606755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1038/2081] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:45:36.610905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.620832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5595fb7-dede-4658-9892-e1ebed080403 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.626185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.627078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.627375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.627660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] PATH_INFO: `/v3/projects/97769c3562364f45a93d687424702dc3/users/eb6aa9d2e15c42b29bd8d5864f21c433/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.646973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=97769c3562364f45a93d687424702dc3, user_id=eb6aa9d2e15c42b29bd8d5864f21c433, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.649636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.662612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1044/2082] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:45:36 2022] PUT /identity/v3/projects/97769c3562364f45a93d687424702dc3/users/eb6aa9d2e15c42b29bd8d5864f21c433/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:45:36.673742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887f6b-4eb5-4a8e-ae27-f05452cb3b3e None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.674050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887f6b-4eb5-4a8e-ae27-f05452cb3b3e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.674344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887f6b-4eb5-4a8e-ae27-f05452cb3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.709865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e9887f6b-4eb5-4a8e-ae27-f05452cb3b3e None None] MFA Rules not processed for user `eb6aa9d2e15c42b29bd8d5864f21c433`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:45:36.711037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e9887f6b-4eb5-4a8e-ae27-f05452cb3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.783409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1039/2083] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:45:36.793157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:36.794859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:36.857657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24ce0d-8ab1-4dd1-a193-567ef6570e5c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:36.861374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:36.861954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:36.862245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:36.862531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:36.871071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:36.872609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:36.881102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1045/2084] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:36 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:45:43.696617 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9887f6b-4eb5-4a8e-ae27-f05452cb3b3e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:45:43.707849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9887f6b-4eb5-4a8e-ae27-f05452cb3b3e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:45:43.712082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0eb502-b798-429c-a674-d7c9dc18b6db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:45:43.712674 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0eb502-b798-429c-a674-d7c9dc18b6db service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:45:43.712951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0eb502-b798-429c-a674-d7c9dc18b6db service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:45:43.713233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0eb502-b798-429c-a674-d7c9dc18b6db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:45:43.715692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2f0eb502-b798-429c-a674-d7c9dc18b6db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:45:43.798176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0eb502-b798-429c-a674-d7c9dc18b6db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:45:43.799628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0eb502-b798-429c-a674-d7c9dc18b6db service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:45:43.814412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1040/2085] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:45:43 2022] GET /identity/v3/auth/tokens => generated 3749 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:40.506061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:40.581653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9fa011-298f-49ba-804f-fb5be46be46f service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:40.586144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:40.586942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:40.587241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:40.587532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] PATH_INFO: `/v3/users/eb6aa9d2e15c42b29bd8d5864f21c433` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:40.588677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6aa9d2e15c42b29bd8d5864f21c433)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:40.590626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:40.655345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6aa9d2e15c42b29bd8d5864f21c433'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:40.664133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6aa9d2e15c42b29bd8d5864f21c433'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:40.664929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6aa9d2e15c42b29bd8d5864f21c433'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:40.665544 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6aa9d2e15c42b29bd8d5864f21c433'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:40.678165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6aa9d2e15c42b29bd8d5864f21c433'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:40.693761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1046/2086] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:40 2022] DELETE /identity/v3/users/eb6aa9d2e15c42b29bd8d5864f21c433 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:40.698259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:40.698736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:40.698829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:40.721362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:40.722580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:40.787404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1041/2087] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:40.799139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:40.800601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:40.865474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92105217-9c0e-4cae-b976-dd7bf62371ba admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:40.869031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:40.869623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:40.869917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:40.870203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:40.880192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:40.881632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:40.892169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1047/2088] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:41.292824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:41.296036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:41.316427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6f42-669b-4e02-bdb3-6475e9417b45 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:41.320891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:41.321732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:41.322021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:41.322341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] PATH_INFO: `/v3/projects/97769c3562364f45a93d687424702dc3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:41.323540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=97769c3562364f45a93d687424702dc3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:41.325575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:41.376726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97769c3562364f45a93d687424702dc3', 'request_id': 'req-0de0a640-9c5d-41d9-9a0d-c10be47198ae'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:41.381600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97769c3562364f45a93d687424702dc3', 'request_id': 'req-0de0a640-9c5d-41d9-9a0d-c10be47198ae'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:41.388451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97769c3562364f45a93d687424702dc3', 'request_id': 'req-0de0a640-9c5d-41d9-9a0d-c10be47198ae'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:41.404415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] The token cache is being invalidate because project 97769c3562364f45a93d687424702dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:41.404706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:41.405336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0de0a640-9c5d-41d9-9a0d-c10be47198ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:41.406784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1042/2089] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:41 2022] DELETE /identity/v3/projects/97769c3562364f45a93d687424702dc3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:48.721894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:48.723272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:48.736035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67b7c5-342e-4883-a89b-ca4d71d44ad8 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:48.800873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:48.802001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:48.802296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:48.802586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] PATH_INFO: `/v3/users/bf87a5923272441896b3309563346485` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:48.803704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf87a5923272441896b3309563346485)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:48.805648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:48.851747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf87a5923272441896b3309563346485'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:48.859806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf87a5923272441896b3309563346485'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:48.860507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf87a5923272441896b3309563346485'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:48.861117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf87a5923272441896b3309563346485'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:48.872773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf87a5923272441896b3309563346485'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:48.884786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1048/2090] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:48 2022] DELETE /identity/v3/users/bf87a5923272441896b3309563346485 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:48.889377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:48.889874 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:48.889981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:48.914436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:48.915610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:48.981609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1043/2091] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:48.992483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:48.993937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:49.062072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e520cb-7649-4d16-a206-f913d5509813 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:49.065574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1694b291-4de5-41fc-b25a-db8f4725f4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:49.066168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b291-4de5-41fc-b25a-db8f4725f4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.066446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b291-4de5-41fc-b25a-db8f4725f4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.066838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694b291-4de5-41fc-b25a-db8f4725f4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.076165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b291-4de5-41fc-b25a-db8f4725f4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:49.077758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1694b291-4de5-41fc-b25a-db8f4725f4d9 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:49.086704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1049/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:49.455123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:49.456627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:49.469233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8676859-9361-4e59-9252-ca81d948e7be None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:49.473678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:49.474568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.474992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.475375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] PATH_INFO: `/v3/projects/d107cb8af6ba4ec1a0ed81b5f0b808b2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.476565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d107cb8af6ba4ec1a0ed81b5f0b808b2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:49.478586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:49.530878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd107cb8af6ba4ec1a0ed81b5f0b808b2', 'request_id': 'req-c1f57863-ec5d-4886-b197-85ac20b473ca'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:49.536010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd107cb8af6ba4ec1a0ed81b5f0b808b2', 'request_id': 'req-c1f57863-ec5d-4886-b197-85ac20b473ca'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:49.542883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd107cb8af6ba4ec1a0ed81b5f0b808b2', 'request_id': 'req-c1f57863-ec5d-4886-b197-85ac20b473ca'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:49.564783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] The token cache is being invalidate because project d107cb8af6ba4ec1a0ed81b5f0b808b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:49.565087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:49.565864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c1f57863-ec5d-4886-b197-85ac20b473ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:49.567813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1044/2093] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:49 2022] DELETE /identity/v3/projects/d107cb8af6ba4ec1a0ed81b5f0b808b2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:49.573223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0af374-1c6a-4c8f-96af-6544d1dfaf25 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.573641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0af374-1c6a-4c8f-96af-6544d1dfaf25 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.573986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0af374-1c6a-4c8f-96af-6544d1dfaf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.598761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bd0af374-1c6a-4c8f-96af-6544d1dfaf25 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:49.600038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bd0af374-1c6a-4c8f-96af-6544d1dfaf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:49.684231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1050/2094] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:49.689343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4081a1-d307-4e97-9315-52f0f93a8c29 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.690692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4081a1-d307-4e97-9315-52f0f93a8c29 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.691488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4081a1-d307-4e97-9315-52f0f93a8c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.719038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4d4081a1-d307-4e97-9315-52f0f93a8c29 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:49.720281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4d4081a1-d307-4e97-9315-52f0f93a8c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:49.727620 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1045/2095] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:49.731892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0af374-1c6a-4c8f-96af-6544d1dfaf25 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:49.742275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0af374-1c6a-4c8f-96af-6544d1dfaf25 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:49.751716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:49.752370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.752668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.752956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.753669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:46:49.753974 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:49.755720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:49.771971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1051/2096] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:46:49.773802 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4081a1-d307-4e97-9315-52f0f93a8c29 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:49.783766 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4081a1-d307-4e97-9315-52f0f93a8c29 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:49.788353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:49.788944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.789258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.789564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.790195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:49.792176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:49.821263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1046/2097] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:49 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:46:49.826031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:49.835792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463751e-1111-4f0a-9fad-bb285675829a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:49.899682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:49.900250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.900540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.900824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.901466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:49.903364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:49.922597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1052/2098] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:49 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:49.927093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:49.936845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795c9fe-66a7-4ff5-8eed-760dc0f2921c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:49.941128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:49.941713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.942001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.942284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.942982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:49.944596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:49.955161 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1047/2099] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:49.959241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:49.971381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b5eef-2a3b-4293-a0aa-673b0a2800c2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:49.975823 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cb67c-c7e1-4a8f-8657-19914ebc5add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:49.976443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cb67c-c7e1-4a8f-8657-19914ebc5add admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:49.976740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cb67c-c7e1-4a8f-8657-19914ebc5add admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:49.977018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cb67c-c7e1-4a8f-8657-19914ebc5add admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:49.977733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cb67c-c7e1-4a8f-8657-19914ebc5add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:49.979462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cb67c-c7e1-4a8f-8657-19914ebc5add admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:49.992850 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1053/2100] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:49.997675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.009312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b920-8433-42d2-ad3c-fc6c319fc3c0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:50.015618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:50.016549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.016926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.017253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] PATH_INFO: `/v3/projects/f648ffbed31f4192b6f16124451b3559/users/bf2c93aa211c4587a97533f4b4e50b11/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.037314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f648ffbed31f4192b6f16124451b3559, user_id=bf2c93aa211c4587a97533f4b4e50b11, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:50.040320 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:50.053442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1048/2101] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:49 2022] PUT /identity/v3/projects/f648ffbed31f4192b6f16124451b3559/users/bf2c93aa211c4587a97533f4b4e50b11/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:50.058595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.058892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.059177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.082146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:50.083295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.148936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1054/2102] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:50.159555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.161272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.224354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b999aa1-0c30-4938-a1fd-01ed35d23304 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:50.227830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be7b58-5be7-446e-8163-c01600ac50d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:50.228434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7b58-5be7-446e-8163-c01600ac50d4 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.228726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7b58-5be7-446e-8163-c01600ac50d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.229042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be7b58-5be7-446e-8163-c01600ac50d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.237918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be7b58-5be7-446e-8163-c01600ac50d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:50.239332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be7b58-5be7-446e-8163-c01600ac50d4 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:50.248737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1049/2103] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:50.446244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.449003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.473111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f28f5d-3ef6-493e-b749-946b0581f841 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:50.480101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:50.481002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.481364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.481853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] PATH_INFO: `/v3/users/1b9f6f4bde6141d1ba2ccc3b6f16fbda` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.483127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9f6f4bde6141d1ba2ccc3b6f16fbda)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:50.485132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:50.539752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9f6f4bde6141d1ba2ccc3b6f16fbda'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.548401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9f6f4bde6141d1ba2ccc3b6f16fbda'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.549245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9f6f4bde6141d1ba2ccc3b6f16fbda'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.549911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9f6f4bde6141d1ba2ccc3b6f16fbda'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.563423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9f6f4bde6141d1ba2ccc3b6f16fbda'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.577277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1055/2104] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:50 2022] DELETE /identity/v3/users/1b9f6f4bde6141d1ba2ccc3b6f16fbda => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:50.581656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.581979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.582400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.604348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:50.605509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.683039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1050/2105] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:50.694444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.695902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.762445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792e3a3-b7cb-46aa-b76c-24e96cef4dc5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:50.766772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d2e24-ed9f-421c-a4f5-239fe228af2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:50.767357 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2e24-ed9f-421c-a4f5-239fe228af2e service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.767650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2e24-ed9f-421c-a4f5-239fe228af2e service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.768016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d2e24-ed9f-421c-a4f5-239fe228af2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.777870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2e24-ed9f-421c-a4f5-239fe228af2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:50.780407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d2e24-ed9f-421c-a4f5-239fe228af2e service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:50.789985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1056/2106] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:50.850584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:50.852858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:50.865700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33692cb5-ed1b-48d5-88bb-d4834f9f6a26 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:50.871671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:50.873505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.873505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.873980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] PATH_INFO: `/v3/users/93817a58756242f5b051f3481952fc4d` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:50.875460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=93817a58756242f5b051f3481952fc4d)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:50.877430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:50.945754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93817a58756242f5b051f3481952fc4d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.946857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93817a58756242f5b051f3481952fc4d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.960842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93817a58756242f5b051f3481952fc4d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.961597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93817a58756242f5b051f3481952fc4d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.971758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93817a58756242f5b051f3481952fc4d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:50.987151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1051/2107] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:50 2022] DELETE /identity/v3/users/93817a58756242f5b051f3481952fc4d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:50.991652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a876ae-7f75-4715-9bad-c73f009a0e5e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:50.992263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a876ae-7f75-4715-9bad-c73f009a0e5e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:50.992776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a876ae-7f75-4715-9bad-c73f009a0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.019204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-36a876ae-7f75-4715-9bad-c73f009a0e5e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:51.020415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-36a876ae-7f75-4715-9bad-c73f009a0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.100071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1057/2108] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:51.108180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.109704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.187787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882913a-490d-4fea-b02c-9ccec4328e2f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.191303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.191887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.192390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.192679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.202911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.204728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:51.215028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1052/2109] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:51.233145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.233685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.234173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.270140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.272500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.282730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] MFA Rules not processed for user `bf2c93aa211c4587a97533f4b4e50b11`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:51.284954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.286782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1557ae0-cfdd-4de3-8aec-a5e9004360a5 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.292221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.293591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.293898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.295450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] PATH_INFO: `/v3/projects/c746000535844582b919aecb3d40cfb3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.296192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c746000535844582b919aecb3d40cfb3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.298376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:51.370575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c746000535844582b919aecb3d40cfb3', 'request_id': 'req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.378540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c746000535844582b919aecb3d40cfb3', 'request_id': 'req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.390016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c746000535844582b919aecb3d40cfb3', 'request_id': 'req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.399453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1058/2110] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:51.412166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.413742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.416726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] The token cache is being invalidate because project c746000535844582b919aecb3d40cfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:51.417352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.418061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.424030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1053/2111] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:51 2022] DELETE /identity/v3/projects/c746000535844582b919aecb3d40cfb3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:51.427896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.431159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.560389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b4579-43fa-4df5-80f0-8251d0ae8cfa None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.577005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbc1db-2f9f-427c-8f97-2ea4f86286a7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.582317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.583673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.583997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.584287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] PATH_INFO: `/v3/users/e731c8de043f419b9f0b3807e62fd6d9` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.585432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e731c8de043f419b9f0b3807e62fd6d9)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.587786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:51.631403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ffee9-444e-4e10-a17d-77ad98675a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.632139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ffee9-444e-4e10-a17d-77ad98675a67 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.632448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ffee9-444e-4e10-a17d-77ad98675a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.632868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ffee9-444e-4e10-a17d-77ad98675a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.635069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-fb6ffee9-444e-4e10-a17d-77ad98675a67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.674798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e731c8de043f419b9f0b3807e62fd6d9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.675965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e731c8de043f419b9f0b3807e62fd6d9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.692241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e731c8de043f419b9f0b3807e62fd6d9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.694405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e731c8de043f419b9f0b3807e62fd6d9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.706330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e731c8de043f419b9f0b3807e62fd6d9'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.723146 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1054/2112] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:51 2022] DELETE /identity/v3/users/e731c8de043f419b9f0b3807e62fd6d9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:51.732827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ffee9-444e-4e10-a17d-77ad98675a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.734291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ffee9-444e-4e10-a17d-77ad98675a67 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:51.745775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1059/2113] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:51 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:51.758820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:51.760268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:51.852047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126291d-0367-42ae-84f2-44b7d1e885f0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:51.857592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:51.858498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.858794 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.859244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] PATH_INFO: `/v3/projects/55f71ed63ab545b4a52d0a3d8595797c` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.860410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f71ed63ab545b4a52d0a3d8595797c)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:51.862426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:51.920484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f71ed63ab545b4a52d0a3d8595797c', 'request_id': 'req-045088c5-0e7f-46da-810a-cea6eafe3632'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.927286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f71ed63ab545b4a52d0a3d8595797c', 'request_id': 'req-045088c5-0e7f-46da-810a-cea6eafe3632'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.936296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f71ed63ab545b4a52d0a3d8595797c', 'request_id': 'req-045088c5-0e7f-46da-810a-cea6eafe3632'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.956311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] The token cache is being invalidate because project 55f71ed63ab545b4a52d0a3d8595797c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:51.956921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.957520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-045088c5-0e7f-46da-810a-cea6eafe3632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:51.959958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1055/2114] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:51 2022] DELETE /identity/v3/projects/55f71ed63ab545b4a52d0a3d8595797c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:51.965210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:51.965655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:51.966512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:51.988979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:51.990078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.073263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1060/2115] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:52.088695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e5a0c-9b15-45d8-9328-b306c45bd64f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.089134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e5a0c-9b15-45d8-9328-b306c45bd64f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.089506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e5a0c-9b15-45d8-9328-b306c45bd64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.132666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.133139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-061e5a0c-9b15-45d8-9328-b306c45bd64f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.134475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-061e5a0c-9b15-45d8-9328-b306c45bd64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.134738 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.148179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1056/2116] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:52.149470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b015fb2-3b2d-46aa-88b4-65312dfd0fb1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.155170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.156292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.156709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.157052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] PATH_INFO: `/v3/projects/c74a3fba72db4e6fac4fb28b976aa981` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.158362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74a3fba72db4e6fac4fb28b976aa981)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.159672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e5a0c-9b15-45d8-9328-b306c45bd64f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.160772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.171898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e5a0c-9b15-45d8-9328-b306c45bd64f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.176267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.177078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.177370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.177658 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.178360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:46:52.178663 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.180461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.196101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1057/2117] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:46:52.198929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.209774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d393-4488-4af1-91cf-7446ca3b6bad admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.214394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.214976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.215266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.215555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.217028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.218931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.249938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74a3fba72db4e6fac4fb28b976aa981', 'request_id': 'req-d3e810da-10b8-4de4-a833-850797d7dfeb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.254083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1058/2118] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:46:52.257893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.261521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74a3fba72db4e6fac4fb28b976aa981', 'request_id': 'req-d3e810da-10b8-4de4-a833-850797d7dfeb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.276072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74a3fba72db4e6fac4fb28b976aa981', 'request_id': 'req-d3e810da-10b8-4de4-a833-850797d7dfeb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.286908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] The token cache is being invalidate because project c74a3fba72db4e6fac4fb28b976aa981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:52.287410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.287852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3e810da-10b8-4de4-a833-850797d7dfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:52.289652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1061/2119] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:52 2022] DELETE /identity/v3/projects/c74a3fba72db4e6fac4fb28b976aa981 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:52.294683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefdca8-04d3-480c-9510-b2dd835ecdcc None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.295158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefdca8-04d3-480c-9510-b2dd835ecdcc None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.295457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefdca8-04d3-480c-9510-b2dd835ecdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.320499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-beefdca8-04d3-480c-9510-b2dd835ecdcc None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.321710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-beefdca8-04d3-480c-9510-b2dd835ecdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.339882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c01422-fc6f-4b60-99b3-84c4017ec2d7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.346070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.346928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.347388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.347820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.348641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.350693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.373389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1059/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:46:52.377098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.378804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.390413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02231536-6de3-41c3-b83f-c498c2214823 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.391630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1062/2121] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:52.400187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c91f2-0bb2-4fb0-ba74-ac5e74b20547 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.400494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c91f2-0bb2-4fb0-ba74-ac5e74b20547 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.400785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c91f2-0bb2-4fb0-ba74-ac5e74b20547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.402103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.402890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.403361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.404322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.405242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.407000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.418433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1060/2122] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:52.424929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.427604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-088c91f2-0bb2-4fb0-ba74-ac5e74b20547 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.428802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-088c91f2-0bb2-4fb0-ba74-ac5e74b20547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.435304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7235681-fe0b-49b6-9a71-587addd6f95d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.436872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1063/2123] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:52.439704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.440174 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.440335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.440625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.441041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c91f2-0bb2-4fb0-ba74-ac5e74b20547 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.441432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.443022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.450341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c91f2-0bb2-4fb0-ba74-ac5e74b20547 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.454904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.455490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.455782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.456104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.456653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1061/2124] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:52.456793 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:46:52.457134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.458741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.460431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.470956 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d67d24-d814-4f54-b9b7-2360b902b3c0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.472746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1064/2125] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:46:52.475308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eb3aa-9cef-4eed-a3ef-67be39ceacc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.476164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb3aa-9cef-4eed-a3ef-67be39ceacc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.476454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb3aa-9cef-4eed-a3ef-67be39ceacc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.476740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb3aa-9cef-4eed-a3ef-67be39ceacc1 admin admin] PATH_INFO: `/v3/projects/5803239882034777b4f46687e9c9df59/users/4396dec0000641f0a09670730d9a097b/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.477184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.486617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ae99-3685-4b29-957d-cf3ed83e5e5f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.491270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.491852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.492176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.492538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.493129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.495019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.496064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eb3aa-9cef-4eed-a3ef-67be39ceacc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5803239882034777b4f46687e9c9df59, user_id=4396dec0000641f0a09670730d9a097b, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.499303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6eb3aa-9cef-4eed-a3ef-67be39ceacc1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.512362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1062/2126] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:52 2022] PUT /identity/v3/projects/5803239882034777b4f46687e9c9df59/users/4396dec0000641f0a09670730d9a097b/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:52.523541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.523829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.524178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.528815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1065/2127] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:52.529992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.560378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] MFA Rules not processed for user `4396dec0000641f0a09670730d9a097b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.561535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.597368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6788-022c-4088-af8d-083bd6c81a70 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.601785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.602388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.602679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.602966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.603597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.605533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.627259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1066/2128] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:46:52.631102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.634666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1063/2129] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:52.641304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1b11-3643-4452-b9ad-bb690a6699d9 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.645768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.645951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.646550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.646842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.647075 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.647165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.647823 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.649453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.663339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1067/2130] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:52.664331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.674215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e117aa-5d2c-4f4d-baee-97d7288df93b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.678983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.679556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.679848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.680165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.680852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.682440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.696111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1068/2131] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:46:52.697131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.707074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5783ac-674f-4782-a468-2d0979eb8e0c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.711422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e5d60-b91e-4f28-bc76-4a6af37f2d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.712295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e5d60-b91e-4f28-bc76-4a6af37f2d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.712904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e5d60-b91e-4f28-bc76-4a6af37f2d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.713035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e5d60-b91e-4f28-bc76-4a6af37f2d3c admin admin] PATH_INFO: `/v3/projects/aebf612967c24d22a3336a6d41416664/users/40e02c18ee9a440b9ebbcdbea26595d3/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.734636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e5d60-b91e-4f28-bc76-4a6af37f2d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebf612967c24d22a3336a6d41416664, user_id=40e02c18ee9a440b9ebbcdbea26595d3, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.737396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e5d60-b91e-4f28-bc76-4a6af37f2d3c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.738513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0e52b-c214-468f-8c83-694ee1e66fbb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.742133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.742771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.743008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.743297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.750896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1069/2132] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:52 2022] PUT /identity/v3/projects/aebf612967c24d22a3336a6d41416664/users/40e02c18ee9a440b9ebbcdbea26595d3/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:52.753361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.754843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.760728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39921aed-e176-449d-83a4-b13d303ead6d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.761025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39921aed-e176-449d-83a4-b13d303ead6d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.761308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39921aed-e176-449d-83a4-b13d303ead6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.764784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1064/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:52 2022] GET /identity/v3/auth/tokens => generated 3676 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:52.797929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-39921aed-e176-449d-83a4-b13d303ead6d None None] MFA Rules not processed for user `40e02c18ee9a440b9ebbcdbea26595d3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:52.798829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-39921aed-e176-449d-83a4-b13d303ead6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:52.872880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1070/2134] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3708 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:46:52.877331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.888013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edb0ff-eb67-4872-8d55-0c798b6d9bdb service glance] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:52.951951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:52.952562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:52.952852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:52.953136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:52.953774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:52.955666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:52.983333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1065/2135] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:52.987280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39921aed-e176-449d-83a4-b13d303ead6d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:52.997505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39921aed-e176-449d-83a4-b13d303ead6d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.064425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.065039 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.065331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.065620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.066262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.068209 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:53.090479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1071/2136] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:46:52 2022] POST /identity/v3/users => generated 306 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:46:53.092307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.102297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40e954-d17f-4958-b619-39709f783ab2 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.107301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.107836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.108271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.108530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.109423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.111060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:53.122780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1066/2137] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:53.127082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.137286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c850c-b889-4664-b744-b49eb9762a98 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.143021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fb8f6-4bc0-4977-a274-0ca240559944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.143604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb8f6-4bc0-4977-a274-0ca240559944 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.143990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb8f6-4bc0-4977-a274-0ca240559944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.144374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fb8f6-4bc0-4977-a274-0ca240559944 admin admin] PATH_INFO: `/v3/projects/9f3bed696ee244408b8ad3e4ef517ba4/users/7c567c2b13214e3f840bd548eebfc0a2/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.165842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb8f6-4bc0-4977-a274-0ca240559944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3bed696ee244408b8ad3e4ef517ba4, user_id=7c567c2b13214e3f840bd548eebfc0a2, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.168726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fb8f6-4bc0-4977-a274-0ca240559944 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:53.181613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1072/2138] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:53 2022] PUT /identity/v3/projects/9f3bed696ee244408b8ad3e4ef517ba4/users/7c567c2b13214e3f840bd548eebfc0a2/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:46:53.185612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.195368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9466f1e-4072-49ea-a4e6-8053613b3cb5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.264023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.272407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.272715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.273146 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.274013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.275681 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:53.285759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.286326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.286802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.290150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1067/2139] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:46:53.294709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.305860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0abc4a-9e3b-442a-bf34-cf56f67dbb5b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.313461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef6890-06ba-4922-8d15-10f189f7aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.314538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef6890-06ba-4922-8d15-10f189f7aaf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.314968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef6890-06ba-4922-8d15-10f189f7aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.315558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef6890-06ba-4922-8d15-10f189f7aaf8 admin admin] PATH_INFO: `/v3/projects/9f3bed696ee244408b8ad3e4ef517ba4/users/7c567c2b13214e3f840bd548eebfc0a2/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.316805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] MFA Rules not processed for user `bf2c93aa211c4587a97533f4b4e50b11`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:53.317692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef6890-06ba-4922-8d15-10f189f7aaf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3bed696ee244408b8ad3e4ef517ba4, user_id=7c567c2b13214e3f840bd548eebfc0a2, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.317837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.320656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef6890-06ba-4922-8d15-10f189f7aaf8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:53.340016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1068/2140] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:46:53 2022] PUT /identity/v3/projects/9f3bed696ee244408b8ad3e4ef517ba4/users/7c567c2b13214e3f840bd548eebfc0a2/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:53.347969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809d38-4843-4bef-9750-53aaa285e118 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.347969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809d38-4843-4bef-9750-53aaa285e118 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.351400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52809d38-4843-4bef-9750-53aaa285e118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.399396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-52809d38-4843-4bef-9750-53aaa285e118 None None] MFA Rules not processed for user `7c567c2b13214e3f840bd548eebfc0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:53.400678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-52809d38-4843-4bef-9750-53aaa285e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.411882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1073/2141] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:53.484824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1069/2142] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3773 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:53.494782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.496865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:53.587726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8c7e-b10e-453e-bba5-abc016e218b8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.650910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.651505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.651792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.652217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.663477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.665113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:53.675328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1074/2143] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/auth/tokens => generated 3773 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:53.785840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809d38-4843-4bef-9750-53aaa285e118 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:53.795822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52809d38-4843-4bef-9750-53aaa285e118 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:53.799963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:53.800577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:53.800876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:53.801192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:53.872262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:53.873890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:53.882735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1070/2144] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:53 2022] GET /identity/v3/auth/tokens => generated 3708 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:46:54.700205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:54.701964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:54.812307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81553165-148d-48f2-a15b-06d37dee78eb service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:54.816959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e87cc-7aad-407b-b88a-7b90f72d4269 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:54.817547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e87cc-7aad-407b-b88a-7b90f72d4269 service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:54.817840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e87cc-7aad-407b-b88a-7b90f72d4269 service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:54.818133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e87cc-7aad-407b-b88a-7b90f72d4269 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:54.819810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7c9e87cc-7aad-407b-b88a-7b90f72d4269 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:54.832648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e87cc-7aad-407b-b88a-7b90f72d4269 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:54.834438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e87cc-7aad-407b-b88a-7b90f72d4269 service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:54.845505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1075/2145] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:54 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:58.573208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.645912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ee1a-05da-4f64-b574-2b6b086729de service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.650132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.650922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.651216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.651496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] PATH_INFO: `/v3/users/40e02c18ee9a440b9ebbcdbea26595d3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.652612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e02c18ee9a440b9ebbcdbea26595d3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.655187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:58.710352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e02c18ee9a440b9ebbcdbea26595d3'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.711025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e02c18ee9a440b9ebbcdbea26595d3'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.724986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e02c18ee9a440b9ebbcdbea26595d3'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.725854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e02c18ee9a440b9ebbcdbea26595d3'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.735025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e02c18ee9a440b9ebbcdbea26595d3'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:58.757793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1071/2146] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:58 2022] DELETE /identity/v3/users/40e02c18ee9a440b9ebbcdbea26595d3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:58.759876 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.760768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.761201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.784787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:46:58.786185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:58.855531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1076/2147] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:46:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:46:58.865981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:58.867540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:58.938914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cb477-0fb8-4c75-af4b-1c69476c1f52 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:58.942531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:58.943118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:58.943415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:58.943703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:58.953616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:58.955094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:58.964610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1072/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:46:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:46:59.459368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:59.461651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:46:59.474740 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d0a73-6139-4ab2-81c2-d628e2042eb0 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:59.479240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:59.480104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:59.480393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:59.480674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] PATH_INFO: `/v3/projects/aebf612967c24d22a3336a6d41416664` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:59.483029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebf612967c24d22a3336a6d41416664)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:59.484986 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:59.536221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebf612967c24d22a3336a6d41416664', 'request_id': 'req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.543521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebf612967c24d22a3336a6d41416664', 'request_id': 'req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.556387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebf612967c24d22a3336a6d41416664', 'request_id': 'req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.569393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] The token cache is being invalidate because project aebf612967c24d22a3336a6d41416664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:46:59.569683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.570370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.571906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1077/2149] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:46:59 2022] DELETE /identity/v3/projects/aebf612967c24d22a3336a6d41416664 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:46:59.577081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:46:59.587028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0e590-29c9-4ee7-a391-538fcc4b8ede service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:46:59.753526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:46:59.754243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:46:59.754540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:46:59.754829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] PATH_INFO: `/v3/users/7c567c2b13214e3f840bd548eebfc0a2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:46:59.755950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c567c2b13214e3f840bd548eebfc0a2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:46:59.757886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:46:59.805901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c567c2b13214e3f840bd548eebfc0a2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.806604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c567c2b13214e3f840bd548eebfc0a2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.818625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c567c2b13214e3f840bd548eebfc0a2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.819310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c567c2b13214e3f840bd548eebfc0a2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.830404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a4ad4ef1-f4f7-4ec2-8e63-00f0ac576d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c567c2b13214e3f840bd548eebfc0a2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:46:59.844703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1073/2150] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:46:59 2022] DELETE /identity/v3/users/7c567c2b13214e3f840bd548eebfc0a2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:00.216549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.218067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:00.231808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2952dd4-9449-4d68-b1b2-3efb9bdd53ce admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.302834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.303748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.304129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.304496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] PATH_INFO: `/v3/projects/9f3bed696ee244408b8ad3e4ef517ba4` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.305790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3bed696ee244408b8ad3e4ef517ba4)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.308067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:00.355473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3bed696ee244408b8ad3e4ef517ba4', 'request_id': 'req-76744388-0120-40d7-a361-bb6a3521b0a4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.364750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3bed696ee244408b8ad3e4ef517ba4', 'request_id': 'req-76744388-0120-40d7-a361-bb6a3521b0a4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.377394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3bed696ee244408b8ad3e4ef517ba4', 'request_id': 'req-76744388-0120-40d7-a361-bb6a3521b0a4'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.387311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] The token cache is being invalidate because project 9f3bed696ee244408b8ad3e4ef517ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:00.388041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.388381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-76744388-0120-40d7-a361-bb6a3521b0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:00.389835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1078/2151] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:00 2022] DELETE /identity/v3/projects/9f3bed696ee244408b8ad3e4ef517ba4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:00.394675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d22e2-5219-4585-a5d0-3933e002b7b0 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.394971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d22e2-5219-4585-a5d0-3933e002b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.395304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d22e2-5219-4585-a5d0-3933e002b7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.418212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-bf0d22e2-5219-4585-a5d0-3933e002b7b0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:00.420676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bf0d22e2-5219-4585-a5d0-3933e002b7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:00.487352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1074/2152] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:00.494936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e877-8def-41dc-8562-e141298d80e5 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.495232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e877-8def-41dc-8562-e141298d80e5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.495520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412e877-8def-41dc-8562-e141298d80e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.521796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f412e877-8def-41dc-8562-e141298d80e5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:00.522923 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f412e877-8def-41dc-8562-e141298d80e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:00.530819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1079/2153] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:00.535028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d22e2-5219-4585-a5d0-3933e002b7b0 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.545088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d22e2-5219-4585-a5d0-3933e002b7b0 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.549476 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.550151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.550513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.550870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.551885 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:47:00.552296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.553977 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:00.569722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1075/2154] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:47:00.571019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e877-8def-41dc-8562-e141298d80e5 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.584132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412e877-8def-41dc-8562-e141298d80e5 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.588525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.589117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.589408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.589692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.590334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.593298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:00.625080 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1080/2155] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:00 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:00.626482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.636160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f5d02-9dd7-4cee-aa96-6db03f61e06c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.702124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.702733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.703027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.703315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.704012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.705929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:00.727421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1076/2156] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:00 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:00.731535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.741421 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb3001-211e-49f2-ad36-69efda203acb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.745780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.746368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.746660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.747457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.748194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.749892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:00.759878 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1081/2157] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:00.764205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.773595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7554b-2ec8-4507-a31a-cfb007098bdb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.778336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb9bdd-3b11-462d-a735-db678a64f1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.778944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb9bdd-3b11-462d-a735-db678a64f1eb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.779224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb9bdd-3b11-462d-a735-db678a64f1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.779515 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb9bdd-3b11-462d-a735-db678a64f1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.780247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb9bdd-3b11-462d-a735-db678a64f1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.781809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb9bdd-3b11-462d-a735-db678a64f1eb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:00.795053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1077/2158] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:00.796592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:00.806644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a62ee7-166d-49b3-a539-6de6e32dc512 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:00.812594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:00.813408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.813698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.813983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] PATH_INFO: `/v3/projects/85a847b00e7b46ee9041d6dab4d7ec54/users/7b0c6c69ab9341d4be1e66bb140334f5/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.834399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a847b00e7b46ee9041d6dab4d7ec54, user_id=7b0c6c69ab9341d4be1e66bb140334f5, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:00.837893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:00.851477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1082/2159] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:00 2022] PUT /identity/v3/projects/85a847b00e7b46ee9041d6dab4d7ec54/users/7b0c6c69ab9341d4be1e66bb140334f5/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:00.862134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d421-18c1-4646-92be-cfb97f4d7531 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:00.862430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d421-18c1-4646-92be-cfb97f4d7531 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:00.862717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d421-18c1-4646-92be-cfb97f4d7531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:00.900665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b100d421-18c1-4646-92be-cfb97f4d7531 None None] MFA Rules not processed for user `7b0c6c69ab9341d4be1e66bb140334f5`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:00.901841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b100d421-18c1-4646-92be-cfb97f4d7531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:00.990141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1078/2160] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:00 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:00.991381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.061220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b737a1-e52c-4d38-ad34-a48576a58cdf admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.072082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.072697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.072992 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.073282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.073944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.075944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.102045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1083/2161] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:00 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:01.106031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d421-18c1-4646-92be-cfb97f4d7531 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.116936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d421-18c1-4646-92be-cfb97f4d7531 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.180595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.181201 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.181495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.181783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.182434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.184979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.209114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1079/2162] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:01.210506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.220869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed265-55aa-4de5-8c6f-34e84a9aa50c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.225400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.226066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.226446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.226809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.227589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.229299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.240814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1084/2163] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:01.244737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.256248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c737b90-3e69-4b9d-8a54-27701269b00c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.264104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052e1d3-0d91-47ca-a2cc-96d375fbf1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.264811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e1d3-0d91-47ca-a2cc-96d375fbf1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.265170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e1d3-0d91-47ca-a2cc-96d375fbf1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.265519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052e1d3-0d91-47ca-a2cc-96d375fbf1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.266297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052e1d3-0d91-47ca-a2cc-96d375fbf1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.267953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052e1d3-0d91-47ca-a2cc-96d375fbf1d7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.279017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1080/2164] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:47:01.283229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.293101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93cd5-c49c-44f8-b953-44dd7b51f7b0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.298730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.299561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.299849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.300155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] PATH_INFO: `/v3/projects/08cbc14cefc840ab9be86eaca498b851/users/54165b4878fb4847985dea47ed0b18da/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.320296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cbc14cefc840ab9be86eaca498b851, user_id=54165b4878fb4847985dea47ed0b18da, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.322840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.337105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1085/2165] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:01 2022] PUT /identity/v3/projects/08cbc14cefc840ab9be86eaca498b851/users/54165b4878fb4847985dea47ed0b18da/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:01.347898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3ce5-052b-447a-abd1-30f4b123f876 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.348228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3ce5-052b-447a-abd1-30f4b123f876 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.349113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c3ce5-052b-447a-abd1-30f4b123f876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.390822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8d7c3ce5-052b-447a-abd1-30f4b123f876 None None] MFA Rules not processed for user `54165b4878fb4847985dea47ed0b18da`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:01.393190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8d7c3ce5-052b-447a-abd1-30f4b123f876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:01.465263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1081/2166] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:01.470161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.540971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95c955-3745-40ec-887a-a4646038f273 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.547232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.547845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.548168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.548459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.549111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.551025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.577572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1086/2167] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:01.581548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c3ce5-052b-447a-abd1-30f4b123f876 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.592598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c3ce5-052b-447a-abd1-30f4b123f876 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.656264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.656923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.657204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.657491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.658135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.660083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.680306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1082/2168] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:01 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:01.684251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.694608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e2508-cd1d-44f8-84e5-ac05bede4f2b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.698935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.699532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.699826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.700136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.700834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.702419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.714180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1087/2169] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:01.719008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.729534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e851e6b-47c1-4344-b3e6-9cc4be5cdc18 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.734730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.735559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.735853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.736170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] PATH_INFO: `/v3/projects/0475049418d0467f98f0bb151687b571/users/dc4268206a324013b4fc2f5c7249782f/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.756193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0475049418d0467f98f0bb151687b571, user_id=dc4268206a324013b4fc2f5c7249782f, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.758831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.771375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1083/2170] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:01 2022] PUT /identity/v3/projects/0475049418d0467f98f0bb151687b571/users/dc4268206a324013b4fc2f5c7249782f/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:01.775425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.785638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f122e04-7f91-4f99-8cbc-61446c66e90a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.952469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b11a-d209-4132-8089-786d264da709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.953086 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b11a-d209-4132-8089-786d264da709 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.953382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b11a-d209-4132-8089-786d264da709 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.953820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b11a-d209-4132-8089-786d264da709 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.954364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b11a-d209-4132-8089-786d264da709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:01.956027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b11a-d209-4132-8089-786d264da709 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:01.967496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1088/2171] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:01.972013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:01.982899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d6765-19be-4e22-8ec6-b689d2549b24 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:01.993725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:01.994604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:01.994898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:01.995190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] PATH_INFO: `/v3/projects/0475049418d0467f98f0bb151687b571/users/dc4268206a324013b4fc2f5c7249782f/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:01.997294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0475049418d0467f98f0bb151687b571, user_id=dc4268206a324013b4fc2f5c7249782f, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.002016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:02.027828 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1084/2172] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:01 2022] PUT /identity/v3/projects/0475049418d0467f98f0bb151687b571/users/dc4268206a324013b4fc2f5c7249782f/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:02.038679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.039393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.039560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.078306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] MFA Rules not processed for user `dc4268206a324013b4fc2f5c7249782f`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:02.079520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:02.154107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1089/2173] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:02.164403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.165945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:02.231359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef88ff6-e3a2-4c09-b2f0-e1c386305c89 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.234814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.235389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.235680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.235993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.244619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.246036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:02.255406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1085/2174] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:02 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:02.317379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:02.318748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:02.341364 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5592521-f771-4aa4-a23d-3d7e24dbbda5 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:02.350183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44562299-d25f-4892-b7be-6cf5345ebadb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:02.350769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44562299-d25f-4892-b7be-6cf5345ebadb service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:02.351250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44562299-d25f-4892-b7be-6cf5345ebadb service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:02.351527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44562299-d25f-4892-b7be-6cf5345ebadb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:02.419540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44562299-d25f-4892-b7be-6cf5345ebadb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:02.420932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44562299-d25f-4892-b7be-6cf5345ebadb service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:02.430350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1090/2175] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:02 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:06.744652 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:06.815115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3759a7-4772-4706-a371-d95e34d92822 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:06.819649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:06.820492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.820790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.821100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] PATH_INFO: `/v3/users/7b0c6c69ab9341d4be1e66bb140334f5` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.822246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0c6c69ab9341d4be1e66bb140334f5)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:06.824221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:06.873737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0c6c69ab9341d4be1e66bb140334f5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:06.874420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0c6c69ab9341d4be1e66bb140334f5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:06.888428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0c6c69ab9341d4be1e66bb140334f5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:06.889132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0c6c69ab9341d4be1e66bb140334f5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:06.898025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0c6c69ab9341d4be1e66bb140334f5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:06.910353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1086/2176] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:06 2022] DELETE /identity/v3/users/7b0c6c69ab9341d4be1e66bb140334f5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:06.914859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:06.915315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:06.915438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:06.937641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:06.938826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:07.007066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1091/2177] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:07.017907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:07.019247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:07.084877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931425-3f59-47d1-b3f8-af9d29fb3e52 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:07.089552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:07.090166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:07.090555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:07.090847 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:07.102458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:07.103997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:07.114245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1087/2178] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:07.494829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:07.496235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:07.510244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d7ec-ee55-4ef3-9ce1-f06a2e169843 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:07.515254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:07.516231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:07.516528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:07.516821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] PATH_INFO: `/v3/projects/85a847b00e7b46ee9041d6dab4d7ec54` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:07.517937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a847b00e7b46ee9041d6dab4d7ec54)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:07.519839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:07.577907 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a847b00e7b46ee9041d6dab4d7ec54', 'request_id': 'req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.585500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a847b00e7b46ee9041d6dab4d7ec54', 'request_id': 'req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.597398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a847b00e7b46ee9041d6dab4d7ec54', 'request_id': 'req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.608424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] The token cache is being invalidate because project 85a847b00e7b46ee9041d6dab4d7ec54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:07.608702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.609425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.611847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1092/2179] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:07 2022] DELETE /identity/v3/projects/85a847b00e7b46ee9041d6dab4d7ec54 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:07.615700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:07.626248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a334882-39b5-4d22-b9bb-4e778c3b5b21 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:07.692601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:07.693341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:07.693638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:07.693922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] PATH_INFO: `/v3/users/54165b4878fb4847985dea47ed0b18da` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:07.695062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54165b4878fb4847985dea47ed0b18da)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:07.697014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:07.745942 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54165b4878fb4847985dea47ed0b18da'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.746865 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54165b4878fb4847985dea47ed0b18da'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.759301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54165b4878fb4847985dea47ed0b18da'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.760004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54165b4878fb4847985dea47ed0b18da'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.767771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54165b4878fb4847985dea47ed0b18da'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:07.780617 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1088/2180] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:07 2022] DELETE /identity/v3/users/54165b4878fb4847985dea47ed0b18da => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:08.288568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:08.289910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:08.302906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ae607-76a4-4eee-b3a4-298ea6a3ba87 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:08.366841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:08.367654 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:08.367968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:08.368259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] PATH_INFO: `/v3/projects/08cbc14cefc840ab9be86eaca498b851` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:08.369580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cbc14cefc840ab9be86eaca498b851)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:08.372157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:08.423392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cbc14cefc840ab9be86eaca498b851', 'request_id': 'req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.432716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cbc14cefc840ab9be86eaca498b851', 'request_id': 'req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.445061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cbc14cefc840ab9be86eaca498b851', 'request_id': 'req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.455291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] The token cache is being invalidate because project 08cbc14cefc840ab9be86eaca498b851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:08.455590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.456245 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.457688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1093/2181] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:08 2022] DELETE /identity/v3/projects/08cbc14cefc840ab9be86eaca498b851 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:08.461753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:08.463082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:08.475858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a93f71-4aed-4332-8d9d-a97dcb945167 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:08.542522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:08.544029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:08.544324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:08.544612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] PATH_INFO: `/v3/users/dc4268206a324013b4fc2f5c7249782f` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:08.545745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4268206a324013b4fc2f5c7249782f)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:08.547634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:08.597021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4268206a324013b4fc2f5c7249782f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.597668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4268206a324013b4fc2f5c7249782f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.609935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4268206a324013b4fc2f5c7249782f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.610877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4268206a324013b4fc2f5c7249782f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.618858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-9b8b7917-cc44-4ccd-a6cc-aebf64100f6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4268206a324013b4fc2f5c7249782f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:08.632300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1089/2182] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:08 2022] DELETE /identity/v3/users/dc4268206a324013b4fc2f5c7249782f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:08.986049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:08.987486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:09.000681 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e23d0-8f0e-4b9f-874b-58b55f4bae44 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.062772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.063558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.063846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.064156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] PATH_INFO: `/v3/projects/0475049418d0467f98f0bb151687b571` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.065247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0475049418d0467f98f0bb151687b571)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.067127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.114733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0475049418d0467f98f0bb151687b571', 'request_id': 'req-a25b0769-a487-4258-9efa-d7f258f56145'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:09.122243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0475049418d0467f98f0bb151687b571', 'request_id': 'req-a25b0769-a487-4258-9efa-d7f258f56145'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:09.133323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0475049418d0467f98f0bb151687b571', 'request_id': 'req-a25b0769-a487-4258-9efa-d7f258f56145'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:09.143489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] The token cache is being invalidate because project 0475049418d0467f98f0bb151687b571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:09.143776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:09.144436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a25b0769-a487-4258-9efa-d7f258f56145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:09.145852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1094/2183] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:08 2022] DELETE /identity/v3/projects/0475049418d0467f98f0bb151687b571 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:09.151804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165ddbc-9509-45eb-b0a2-00c77856fc06 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.152316 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165ddbc-9509-45eb-b0a2-00c77856fc06 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.152457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165ddbc-9509-45eb-b0a2-00c77856fc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.175814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b165ddbc-9509-45eb-b0a2-00c77856fc06 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:09.177260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b165ddbc-9509-45eb-b0a2-00c77856fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:09.241215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1090/2184] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:09.250417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ac76e-5a48-4969-81c6-4a5720bfc93f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.250822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ac76e-5a48-4969-81c6-4a5720bfc93f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.251176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ac76e-5a48-4969-81c6-4a5720bfc93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.274630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-289ac76e-5a48-4969-81c6-4a5720bfc93f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:09.275970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-289ac76e-5a48-4969-81c6-4a5720bfc93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:09.283623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1095/2185] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:09.287884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165ddbc-9509-45eb-b0a2-00c77856fc06 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:09.297975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165ddbc-9509-45eb-b0a2-00c77856fc06 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.302719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.303309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.303606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.303894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.304656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:47:09.304961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.306535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.319665 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1091/2186] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:47:09.324279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ac76e-5a48-4969-81c6-4a5720bfc93f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:09.334152 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ac76e-5a48-4969-81c6-4a5720bfc93f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.338714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.339307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.339600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.339890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.340742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.342810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.370314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1096/2187] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:09 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:09.375459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:09.385151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0df0ec-a733-4bf1-9a8e-0818e642e8bf admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.457985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.459545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.459545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.459545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.460358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.462305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.491973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1092/2188] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:09 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:09.494419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:09.512542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba075ef-1ff0-4769-8110-3296bf13b9b8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.523983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.525777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.526568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.527352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.529552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.532940 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.557937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1097/2189] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:09.565346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:09.597442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2538c38-5b8b-452e-b42b-493cb05dbab2 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.606907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8adba-6bfa-4623-985d-bd407abb8a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.608246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8adba-6bfa-4623-985d-bd407abb8a71 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.608950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8adba-6bfa-4623-985d-bd407abb8a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.609594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8adba-6bfa-4623-985d-bd407abb8a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.611190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8adba-6bfa-4623-985d-bd407abb8a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.614722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8adba-6bfa-4623-985d-bd407abb8a71 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.643390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1093/2190] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:09.645440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:09.664059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0e672-2cea-4dc8-9bf3-ab2f5fc48de0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.669768 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.670707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.671099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.671398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] PATH_INFO: `/v3/projects/5fa2bd1a28cf49cab31cea7a963f941c/users/72f45ffba6ed43d4a3d426ebe1168498/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.696066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa2bd1a28cf49cab31cea7a963f941c, user_id=72f45ffba6ed43d4a3d426ebe1168498, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.698725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.713946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1098/2191] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:09 2022] PUT /identity/v3/projects/5fa2bd1a28cf49cab31cea7a963f941c/users/72f45ffba6ed43d4a3d426ebe1168498/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:09.726616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1b51-c4b4-4242-a559-3c845658fb06 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.726956 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1b51-c4b4-4242-a559-3c845658fb06 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.727290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1b51-c4b4-4242-a559-3c845658fb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.765852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-baec1b51-c4b4-4242-a559-3c845658fb06 None None] MFA Rules not processed for user `72f45ffba6ed43d4a3d426ebe1168498`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:09.767123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-baec1b51-c4b4-4242-a559-3c845658fb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:09.854727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1094/2192] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:09.867262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:09.868795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:09.952598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb5d33-9a79-47da-a2ea-7a8f4f395bd8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:09.956230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:09.956817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:09.957111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:09.957399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:09.966653 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:09.968137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:09.977218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1099/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:09 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:14.185805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b467b3-d6c9-4b13-b843-7e2529fefc23 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:14.186275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b467b3-d6c9-4b13-b843-7e2529fefc23 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:14.186383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b467b3-d6c9-4b13-b843-7e2529fefc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:14.207999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d6b467b3-d6c9-4b13-b843-7e2529fefc23 None None] MFA Rules not processed for user `b3cc30404a3c4a16aff55c90e698e489`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:14.209150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d6b467b3-d6c9-4b13-b843-7e2529fefc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:14.272095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1095/2194] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:14 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:41.436388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:41.437747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:41.509057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22030-5bd5-4e2b-82ef-c69a3933e8f8 service glance] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:41.514131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:41.514937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:41.515229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:41.515513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] PATH_INFO: `/v3/users/4396dec0000641f0a09670730d9a097b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:41.516637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4396dec0000641f0a09670730d9a097b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:41.519149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:41.572160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4396dec0000641f0a09670730d9a097b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:41.580242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4396dec0000641f0a09670730d9a097b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:41.580918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4396dec0000641f0a09670730d9a097b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:41.581567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4396dec0000641f0a09670730d9a097b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:41.593214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4396dec0000641f0a09670730d9a097b'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:41.606141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1100/2195] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:41 2022] DELETE /identity/v3/users/4396dec0000641f0a09670730d9a097b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:41.610496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:41.611016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:41.611206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:41.632744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:41.633915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:41.698220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1096/2196] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:41.708914 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:41.710303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:41.776023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f797bcb-6992-468f-bd30-6ccd30d1cdbb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:41.779605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0034de7-5dcd-4b06-9000-c4e8702b8cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:41.780211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034de7-5dcd-4b06-9000-c4e8702b8cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:41.780547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034de7-5dcd-4b06-9000-c4e8702b8cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:41.780833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0034de7-5dcd-4b06-9000-c4e8702b8cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:41.792498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0034de7-5dcd-4b06-9000-c4e8702b8cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:41.793936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0034de7-5dcd-4b06-9000-c4e8702b8cd0 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:41.804687 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1101/2197] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:42.337700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.339031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:42.350923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c872-a424-4029-ac18-7fffd3645e88 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.355512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.356307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.356597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.356866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] PATH_INFO: `/v3/projects/5803239882034777b4f46687e9c9df59` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.357963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5803239882034777b4f46687e9c9df59)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.359850 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:42.406547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5803239882034777b4f46687e9c9df59', 'request_id': 'req-4f474379-ff82-435f-ae92-3482bbecdde2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:42.412057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5803239882034777b4f46687e9c9df59', 'request_id': 'req-4f474379-ff82-435f-ae92-3482bbecdde2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:42.418053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5803239882034777b4f46687e9c9df59', 'request_id': 'req-4f474379-ff82-435f-ae92-3482bbecdde2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:42.434511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] The token cache is being invalidate because project 5803239882034777b4f46687e9c9df59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:42.434801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:42.435424 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-4f474379-ff82-435f-ae92-3482bbecdde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:42.436876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1097/2198] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:42 2022] DELETE /identity/v3/projects/5803239882034777b4f46687e9c9df59 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:42.442490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1740a69-1bcc-4a32-a338-71475cddd6e1 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.443050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1740a69-1bcc-4a32-a338-71475cddd6e1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.443147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1740a69-1bcc-4a32-a338-71475cddd6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.465515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-d1740a69-1bcc-4a32-a338-71475cddd6e1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:42.466664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d1740a69-1bcc-4a32-a338-71475cddd6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:42.531792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1102/2199] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:47:42.540857 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b9de4-7a81-45b0-ae34-8268bfad39b7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.541090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b9de4-7a81-45b0-ae34-8268bfad39b7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.541385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b9de4-7a81-45b0-ae34-8268bfad39b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.563875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e60b9de4-7a81-45b0-ae34-8268bfad39b7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:42.565615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e60b9de4-7a81-45b0-ae34-8268bfad39b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:42.572940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1098/2200] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:42.577072 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1740a69-1bcc-4a32-a338-71475cddd6e1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.586517 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1740a69-1bcc-4a32-a338-71475cddd6e1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.590820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.591401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.591716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.592034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.592723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:47:42.593020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.594586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:42.607864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1103/2201] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:47:42.612518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b9de4-7a81-45b0-ae34-8268bfad39b7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.623550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b9de4-7a81-45b0-ae34-8268bfad39b7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.628804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.629495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.629864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.630225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.630991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.633061 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:42.664098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1099/2202] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:42 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:42.666175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.678054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f0f2c-d502-4d9f-8b60-0d0e1365d7d1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.753780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.754311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.754599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.754889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.757217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.757484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:42.783965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1104/2203] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:42 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:42.787378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.797301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f162e-113a-4620-a16c-5385172edf77 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.802089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.802673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.802966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.803253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.803968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.805571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:42.816238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1100/2204] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:47:42.819976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.830242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504646-eb63-40e2-b6db-b5cdb52ccc65 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.834959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ea626-5cb2-4e2a-b117-54f858bca424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.835556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ea626-5cb2-4e2a-b117-54f858bca424 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.835847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ea626-5cb2-4e2a-b117-54f858bca424 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.836160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ea626-5cb2-4e2a-b117-54f858bca424 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.836863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ea626-5cb2-4e2a-b117-54f858bca424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.838443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ea626-5cb2-4e2a-b117-54f858bca424 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:42.848962 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1105/2205] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:42.852922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:42.863372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db379fa-74ad-46c7-a2b5-a8910412c357 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:42.867784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:42.868854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.869221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.869588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] PATH_INFO: `/v3/projects/29c22967f22f4dc99308c81a2b3ee7e1/users/ee2bad88c6bd42c28574937c9e8f8d5d/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.889636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c22967f22f4dc99308c81a2b3ee7e1, user_id=ee2bad88c6bd42c28574937c9e8f8d5d, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:42.892496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:42.905861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1101/2206] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:42 2022] PUT /identity/v3/projects/29c22967f22f4dc99308c81a2b3ee7e1/users/ee2bad88c6bd42c28574937c9e8f8d5d/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:47:42.916340 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a0e4-1f17-4647-bedd-e8dc28699d65 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:42.916729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a0e4-1f17-4647-bedd-e8dc28699d65 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:42.917020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7a0e4-1f17-4647-bedd-e8dc28699d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:42.954264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-cda7a0e4-1f17-4647-bedd-e8dc28699d65 None None] MFA Rules not processed for user `ee2bad88c6bd42c28574937c9e8f8d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:42.955452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cda7a0e4-1f17-4647-bedd-e8dc28699d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:43.027743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1106/2207] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:42 2022] POST /identity/v3/auth/tokens => generated 3706 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:43.040182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:43.042027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:43.113928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add225bf-12e2-49d3-8f68-fa447c04fcb7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:43.118301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cca966-6956-4514-9f17-5f81896e97e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:43.118888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cca966-6956-4514-9f17-5f81896e97e4 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:43.119179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cca966-6956-4514-9f17-5f81896e97e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:43.119464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cca966-6956-4514-9f17-5f81896e97e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:43.128489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cca966-6956-4514-9f17-5f81896e97e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:43.129931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cca966-6956-4514-9f17-5f81896e97e4 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:43.138326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1102/2208] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:43 2022] GET /identity/v3/auth/tokens => generated 3706 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:54.905359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a0e4-1f17-4647-bedd-e8dc28699d65 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:54.986934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7a0e4-1f17-4647-bedd-e8dc28699d65 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:54.991677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:54.993023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:54.993386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:54.993676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] PATH_INFO: `/v3/users/ee2bad88c6bd42c28574937c9e8f8d5d` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:54.995243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2bad88c6bd42c28574937c9e8f8d5d)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:54.997270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:55.045889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2bad88c6bd42c28574937c9e8f8d5d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.054265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2bad88c6bd42c28574937c9e8f8d5d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.054944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2bad88c6bd42c28574937c9e8f8d5d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.055557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2bad88c6bd42c28574937c9e8f8d5d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.067723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2bad88c6bd42c28574937c9e8f8d5d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.080408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1107/2209] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:54 2022] DELETE /identity/v3/users/ee2bad88c6bd42c28574937c9e8f8d5d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:55.085129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:55.085621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:55.085961 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:55.107983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:55.109387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:55.176725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1103/2210] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:47:55.186698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:55.188095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:55.253233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a44da-6f6d-4150-ab2c-d9fad34c5b07 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:55.256699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:55.257282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:55.257574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:55.257857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:55.266916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:55.268386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:55.278802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1108/2211] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:55.657591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:55.659079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:55.670972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf335b1e-0338-4764-b374-442a2325e016 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:55.677118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:55.678028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:55.678416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:55.678777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] PATH_INFO: `/v3/projects/29c22967f22f4dc99308c81a2b3ee7e1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:55.679986 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c22967f22f4dc99308c81a2b3ee7e1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:55.681981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:55.733005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c22967f22f4dc99308c81a2b3ee7e1', 'request_id': 'req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.738844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c22967f22f4dc99308c81a2b3ee7e1', 'request_id': 'req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.746664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c22967f22f4dc99308c81a2b3ee7e1', 'request_id': 'req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.764588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] The token cache is being invalidate because project 29c22967f22f4dc99308c81a2b3ee7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:55.765022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.765756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-7993ca1f-a8d9-4c5d-a903-b481e4d6351e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:55.767893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1104/2212] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:55 2022] DELETE /identity/v3/projects/29c22967f22f4dc99308c81a2b3ee7e1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:58.769298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:58.770648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:58.782734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f100cc-1ce6-4158-8d2c-830df498e95c service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:58.847313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:58.848139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:58.848426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:58.848707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] PATH_INFO: `/v3/users/72f45ffba6ed43d4a3d426ebe1168498` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:58.849840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f45ffba6ed43d4a3d426ebe1168498)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:58.851739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:58.898243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f45ffba6ed43d4a3d426ebe1168498'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:58.905715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f45ffba6ed43d4a3d426ebe1168498'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:58.906371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f45ffba6ed43d4a3d426ebe1168498'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:58.906985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f45ffba6ed43d4a3d426ebe1168498'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:58.918358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f45ffba6ed43d4a3d426ebe1168498'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:58.931212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1109/2213] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:47:58 2022] DELETE /identity/v3/users/72f45ffba6ed43d4a3d426ebe1168498 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:58.935638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:58.936113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:58.936229 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:58.958072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:58.959257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:59.023332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1105/2214] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:59.034397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.035734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:59.098903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee444b-711e-4689-b02b-ed242e463d8c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.102353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59959966-f7bc-432c-923d-bc3531277593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.102927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59959966-f7bc-432c-923d-bc3531277593 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.103217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59959966-f7bc-432c-923d-bc3531277593 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.103502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59959966-f7bc-432c-923d-bc3531277593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.112840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59959966-f7bc-432c-923d-bc3531277593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:59.114293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59959966-f7bc-432c-923d-bc3531277593 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:59.123457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1110/2215] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:47:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:47:59.467998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.469378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:59.481573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f34bd-18e7-45d6-bdfc-a675aad677d7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.486777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.487564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.487855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.488170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] PATH_INFO: `/v3/projects/5fa2bd1a28cf49cab31cea7a963f941c` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.489288 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa2bd1a28cf49cab31cea7a963f941c)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:59.491164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:59.540966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa2bd1a28cf49cab31cea7a963f941c', 'request_id': 'req-2c268773-be66-4ce0-9823-0c46f6b17b06'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:59.545752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa2bd1a28cf49cab31cea7a963f941c', 'request_id': 'req-2c268773-be66-4ce0-9823-0c46f6b17b06'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:59.554155 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa2bd1a28cf49cab31cea7a963f941c', 'request_id': 'req-2c268773-be66-4ce0-9823-0c46f6b17b06'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:59.569912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] The token cache is being invalidate because project 5fa2bd1a28cf49cab31cea7a963f941c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:47:59.570217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:59.570860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2c268773-be66-4ce0-9823-0c46f6b17b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:47:59.575642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1106/2216] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:47:59 2022] DELETE /identity/v3/projects/5fa2bd1a28cf49cab31cea7a963f941c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:47:59.577397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57c17-5099-44a2-a85d-995856569671 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.577729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57c17-5099-44a2-a85d-995856569671 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.578059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f57c17-5099-44a2-a85d-995856569671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.606375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a0f57c17-5099-44a2-a85d-995856569671 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:59.607539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a0f57c17-5099-44a2-a85d-995856569671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:59.672574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1111/2217] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:47:59.680429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f4e1-8b1e-4198-9235-ddacf1e642e5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.680746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f4e1-8b1e-4198-9235-ddacf1e642e5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.681044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0f4e1-8b1e-4198-9235-ddacf1e642e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.703039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1ac0f4e1-8b1e-4198-9235-ddacf1e642e5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:47:59.704959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1ac0f4e1-8b1e-4198-9235-ddacf1e642e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:47:59.712531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1107/2218] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:47:59.717034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57c17-5099-44a2-a85d-995856569671 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.727079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f57c17-5099-44a2-a85d-995856569671 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.731377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.731997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.732293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.732579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.733270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:47:59.733575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:59.735196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:59.747483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1112/2219] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:47:59.752181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f4e1-8b1e-4198-9235-ddacf1e642e5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.761175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0f4e1-8b1e-4198-9235-ddacf1e642e5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.765570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.766147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.767071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.767437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.768114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:59.769983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:59.795396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1108/2220] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:47:59 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:47:59.799752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.809763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e8e5-65c3-4e85-a4b1-fdbf313c7140 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.873161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.873759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.874055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.874347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.874990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:59.877459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:59.896714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1113/2221] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:47:59 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:47:59.901404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.911557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386ebf5-8747-464a-9742-d3daf9efd14b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.915881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.916490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.916781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.917065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.917757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:59.919357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:59.929430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1109/2222] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:59.933134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.943212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75cb54-7630-4922-8cad-588ba5195545 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.947585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c294583-d640-459a-8d2f-a1705f49a699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.948203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c294583-d640-459a-8d2f-a1705f49a699 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.948497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c294583-d640-459a-8d2f-a1705f49a699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.948784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c294583-d640-459a-8d2f-a1705f49a699 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.949481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c294583-d640-459a-8d2f-a1705f49a699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:47:59.951052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c294583-d640-459a-8d2f-a1705f49a699 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:47:59.961628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1114/2223] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:47:59.965406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:47:59.974762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9dbd8-0a2f-45e7-a585-35d84b8acc55 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:47:59.979118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:47:59.979914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:47:59.980226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:47:59.980508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] PATH_INFO: `/v3/projects/4ceefbcac3f14280b2bf08be43b66783/users/9179c51bd83242dcbb151b4bde266b9b/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:47:59.998814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ceefbcac3f14280b2bf08be43b66783, user_id=9179c51bd83242dcbb151b4bde266b9b, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.002165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.014271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1110/2224] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:47:59 2022] PUT /identity/v3/projects/4ceefbcac3f14280b2bf08be43b66783/users/9179c51bd83242dcbb151b4bde266b9b/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:00.025518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7672c9c-3303-425b-a0d8-f7df2a1a7474 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.025844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7672c9c-3303-425b-a0d8-f7df2a1a7474 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.026135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7672c9c-3303-425b-a0d8-f7df2a1a7474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.062182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f7672c9c-3303-425b-a0d8-f7df2a1a7474 None None] MFA Rules not processed for user `9179c51bd83242dcbb151b4bde266b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:00.063380 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f7672c9c-3303-425b-a0d8-f7df2a1a7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:00.135668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1115/2225] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:00.140138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.209854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c7ea7-cace-4e2f-9262-431a07f562d0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.214366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.214954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.215248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.215537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.216217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.218102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.243528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1111/2226] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:48:00 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:48:00.247553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7672c9c-3303-425b-a0d8-f7df2a1a7474 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.257921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7672c9c-3303-425b-a0d8-f7df2a1a7474 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.321690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.322018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.322367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.322668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.323314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.325316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.345367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1116/2227] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:48:00 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:48:00.349166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.359027 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aee697-fd4e-4014-a54b-2bb7adc24674 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.363458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.364072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.364387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.364673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.365372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.366940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.377323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1112/2228] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:48:00.381263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.390880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17856f47-2405-4869-a4e7-0ef3bf6555c6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.395754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3586-a97e-4b1e-a4c5-11c75eeb064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.396378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3586-a97e-4b1e-a4c5-11c75eeb064f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.396671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3586-a97e-4b1e-a4c5-11c75eeb064f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.396954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3586-a97e-4b1e-a4c5-11c75eeb064f admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.397649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e3586-a97e-4b1e-a4c5-11c75eeb064f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.399817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e3586-a97e-4b1e-a4c5-11c75eeb064f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.409773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1117/2229] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:48:00.413719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.423525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca92e94-e248-4b2e-b279-3f9c28c4b8ec admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.428139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.428932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.429213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.429491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] PATH_INFO: `/v3/projects/09af71be8f29485bbdb0a3d231a5386b/users/2d8ad6f725914fd5b72a4da0853650e2/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.448253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09af71be8f29485bbdb0a3d231a5386b, user_id=2d8ad6f725914fd5b72a4da0853650e2, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.450859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.463404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1113/2230] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:48:00 2022] PUT /identity/v3/projects/09af71be8f29485bbdb0a3d231a5386b/users/2d8ad6f725914fd5b72a4da0853650e2/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:48:00.473835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9bbba-43fe-4a3f-a321-7fb861dfd032 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.474124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9bbba-43fe-4a3f-a321-7fb861dfd032 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.474417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9bbba-43fe-4a3f-a321-7fb861dfd032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.510545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1fc9bbba-43fe-4a3f-a321-7fb861dfd032 None None] MFA Rules not processed for user `2d8ad6f725914fd5b72a4da0853650e2`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:00.511705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1fc9bbba-43fe-4a3f-a321-7fb861dfd032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:00.582530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1118/2231] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:00.586912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.655884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49f599-c53a-437e-aa6a-f302e3fce797 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.660386 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.660970 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.661265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.661548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.662199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.664114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.690550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1114/2232] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:48:00 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:48:00.694611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9bbba-43fe-4a3f-a321-7fb861dfd032 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.705335 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9bbba-43fe-4a3f-a321-7fb861dfd032 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.769375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.769991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.770282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.770573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.771231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.773156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.796894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1119/2233] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:48:00 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:48:00.799069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.810020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb8fe1-def3-46e6-bd98-17ac9d5a9813 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.818513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.818513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.818513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.818513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.818901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.822450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.838213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1115/2234] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:48:00.839240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.849666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc03b7-7570-4486-a407-6f3578898330 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.854132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.854950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.855242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.855528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] PATH_INFO: `/v3/projects/6e1fc936b34148cdbd69765af00ab481/users/298fd68bcb4e440b9fdf0fc5cfcedbd0/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.876268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1fc936b34148cdbd69765af00ab481, user_id=298fd68bcb4e440b9fdf0fc5cfcedbd0, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.878890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.891831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1120/2235] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:48:00 2022] PUT /identity/v3/projects/6e1fc936b34148cdbd69765af00ab481/users/298fd68bcb4e440b9fdf0fc5cfcedbd0/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:48:00.895562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.905300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10eaf58-8655-4136-beb0-e75266a09721 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.966442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d895b44-707f-4579-a976-0ffc33a08571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:00.967039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895b44-707f-4579-a976-0ffc33a08571 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:00.967332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895b44-707f-4579-a976-0ffc33a08571 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:00.967618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895b44-707f-4579-a976-0ffc33a08571 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:00.968359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d895b44-707f-4579-a976-0ffc33a08571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:00.970499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d895b44-707f-4579-a976-0ffc33a08571 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:00.980630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1116/2236] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:48:00.984603 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:00.994883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285f87b-a2ef-4374-b435-48fcda851c71 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:00.999465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:01.000438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:01.000781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:01.001067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] PATH_INFO: `/v3/projects/6e1fc936b34148cdbd69765af00ab481/users/298fd68bcb4e440b9fdf0fc5cfcedbd0/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:01.002882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1fc936b34148cdbd69765af00ab481, user_id=298fd68bcb4e440b9fdf0fc5cfcedbd0, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:01.005608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:01.015802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1121/2237] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:48:00 2022] PUT /identity/v3/projects/6e1fc936b34148cdbd69765af00ab481/users/298fd68bcb4e440b9fdf0fc5cfcedbd0/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:01.026307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:01.026611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:01.026906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:01.075699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] MFA Rules not processed for user `298fd68bcb4e440b9fdf0fc5cfcedbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:01.076928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:01.155147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1117/2238] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:48:01 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:01.165671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:01.167317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:01.233725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b6b3f-a0a3-4a29-9364-718731c1ea9d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:01.237285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:01.237867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:01.238156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:01.238441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:01.299827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:01.301532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:01.310048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1122/2239] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:01 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:48:02.995362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:02.996756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:03.008631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae21023-83ce-472e-83b1-62f20e14f7a6 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:03.011968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:03.012589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:03.012820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:03.013101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:03.075717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:03.077180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:03.086328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1118/2240] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:02 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:05.725676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:05.734321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e48f6d-1a0c-4b40-aecb-d93d5ccc6972 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:05.738435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca2b7a-d2ce-4603-9529-34d1954c0ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:05.739010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2b7a-d2ce-4603-9529-34d1954c0ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:05.739302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2b7a-d2ce-4603-9529-34d1954c0ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:05.739610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2b7a-d2ce-4603-9529-34d1954c0ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:05.748388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca2b7a-d2ce-4603-9529-34d1954c0ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:05.749802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca2b7a-d2ce-4603-9529-34d1954c0ee3 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:05.759555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1123/2241] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:05 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:15.644413 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:15.714627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398e77-44e3-4e25-8cbe-3309d61238fc service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:15.718998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:15.719725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:15.720052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:15.720346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] PATH_INFO: `/v3/users/9179c51bd83242dcbb151b4bde266b9b` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:15.721478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9179c51bd83242dcbb151b4bde266b9b)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:15.723374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:15.770199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9179c51bd83242dcbb151b4bde266b9b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:15.770877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9179c51bd83242dcbb151b4bde266b9b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:15.782312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9179c51bd83242dcbb151b4bde266b9b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:15.782941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9179c51bd83242dcbb151b4bde266b9b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:15.790364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9179c51bd83242dcbb151b4bde266b9b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:15.802650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1119/2242] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:48:15 2022] DELETE /identity/v3/users/9179c51bd83242dcbb151b4bde266b9b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:15.807238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:15.807689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:15.807822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:15.836451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:15.837604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:15.901303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1124/2243] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:48:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:15.911814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:15.913207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:15.978257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201a016-47a0-4381-9004-d62edfd5dc19 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:15.981642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:15.982218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:15.982550 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:15.982837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:15.993488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:15.994906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:16.004520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1120/2244] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:16.352109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:16.353477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:16.365366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c7521-7836-414d-ba2e-549c14d13b2c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:16.369854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:16.370577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:16.370875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:16.371163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] PATH_INFO: `/v3/projects/4ceefbcac3f14280b2bf08be43b66783` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:16.372404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ceefbcac3f14280b2bf08be43b66783)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:16.374369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:16.431787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ceefbcac3f14280b2bf08be43b66783', 'request_id': 'req-755f7e2e-00f1-4a89-86eb-718ed8648172'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.439578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ceefbcac3f14280b2bf08be43b66783', 'request_id': 'req-755f7e2e-00f1-4a89-86eb-718ed8648172'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.450609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ceefbcac3f14280b2bf08be43b66783', 'request_id': 'req-755f7e2e-00f1-4a89-86eb-718ed8648172'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.460421 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] The token cache is being invalidate because project 4ceefbcac3f14280b2bf08be43b66783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:48:16.460708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.461347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.462801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1125/2245] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:48:16 2022] DELETE /identity/v3/projects/4ceefbcac3f14280b2bf08be43b66783 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:16.466729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:16.476395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a750a8-5417-4978-9cff-f7ea5409b094 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:16.540980 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:16.541788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:16.542084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:16.542372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] PATH_INFO: `/v3/users/2d8ad6f725914fd5b72a4da0853650e2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:16.543489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8ad6f725914fd5b72a4da0853650e2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:16.545412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:16.594233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8ad6f725914fd5b72a4da0853650e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.595440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8ad6f725914fd5b72a4da0853650e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.606645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8ad6f725914fd5b72a4da0853650e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.607274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8ad6f725914fd5b72a4da0853650e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.615848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8ad6f725914fd5b72a4da0853650e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:16.627965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1121/2246] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:48:16 2022] DELETE /identity/v3/users/2d8ad6f725914fd5b72a4da0853650e2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:16.980228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:16.981658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:16.994136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7e2e-00f1-4a89-86eb-718ed8648172 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:17.056489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:17.057280 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:17.057575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:17.057866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] PATH_INFO: `/v3/projects/09af71be8f29485bbdb0a3d231a5386b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:17.059004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09af71be8f29485bbdb0a3d231a5386b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:17.060968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:17.109650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09af71be8f29485bbdb0a3d231a5386b', 'request_id': 'req-4511aa8b-1994-4098-bd6c-9f70fa19b184'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.116553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09af71be8f29485bbdb0a3d231a5386b', 'request_id': 'req-4511aa8b-1994-4098-bd6c-9f70fa19b184'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.129585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09af71be8f29485bbdb0a3d231a5386b', 'request_id': 'req-4511aa8b-1994-4098-bd6c-9f70fa19b184'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.139178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] The token cache is being invalidate because project 09af71be8f29485bbdb0a3d231a5386b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:48:17.139462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.140127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.142233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1126/2247] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:48:16 2022] DELETE /identity/v3/projects/09af71be8f29485bbdb0a3d231a5386b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:17.146211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:17.147549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:17.159577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3a789-c76d-496f-ac73-4d1a28f60ec7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:17.223281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:17.224137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:17.224454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:17.224775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] PATH_INFO: `/v3/users/298fd68bcb4e440b9fdf0fc5cfcedbd0` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:17.225982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=298fd68bcb4e440b9fdf0fc5cfcedbd0)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:17.227892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:17.274148 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298fd68bcb4e440b9fdf0fc5cfcedbd0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.274782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298fd68bcb4e440b9fdf0fc5cfcedbd0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.286240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298fd68bcb4e440b9fdf0fc5cfcedbd0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.286858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298fd68bcb4e440b9fdf0fc5cfcedbd0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.294326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358591d4-eca4-4eb8-b0a8-be043671fd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298fd68bcb4e440b9fdf0fc5cfcedbd0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.307551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1122/2248] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:48:17 2022] DELETE /identity/v3/users/298fd68bcb4e440b9fdf0fc5cfcedbd0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:17.658851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:17.660330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:17.672599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511aa8b-1994-4098-bd6c-9f70fa19b184 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:17.738137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:17.738916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:17.739199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:17.739476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] PATH_INFO: `/v3/projects/6e1fc936b34148cdbd69765af00ab481` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:17.740584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1fc936b34148cdbd69765af00ab481)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:17.742453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:17.791628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1fc936b34148cdbd69765af00ab481', 'request_id': 'req-ae4d108a-dec6-483e-96d1-17fc615b664e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.799481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1fc936b34148cdbd69765af00ab481', 'request_id': 'req-ae4d108a-dec6-483e-96d1-17fc615b664e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.811079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1fc936b34148cdbd69765af00ab481', 'request_id': 'req-ae4d108a-dec6-483e-96d1-17fc615b664e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.821307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] The token cache is being invalidate because project 6e1fc936b34148cdbd69765af00ab481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:48:17.821592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.822214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-ae4d108a-dec6-483e-96d1-17fc615b664e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:48:17.823651 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1127/2249] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:48:17 2022] DELETE /identity/v3/projects/6e1fc936b34148cdbd69765af00ab481 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:48:40.972991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:40.973486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:40.973597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:40.995826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] MFA Rules not processed for user `44a64fb1ebd9411eb6156c8ef97c3072`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:40.997029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:41.056728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1123/2250] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:48:40 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:44.118284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.118799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.118896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.262862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:44.264837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:44.365984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1128/2251] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:48:44 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:44.411858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:44.413274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:44.562827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb71b-dc36-4b3a-b7c2-de0bea2cdbca None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:44.576311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:44.576913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:44.577208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:44.577537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:44.595729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:44.598007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:44.610829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1124/2252] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:48:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:48:48.780386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:48.782093 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:48.867053 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f98c6-4120-469e-8d58-a03ee096184a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:48.871194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d90a81-4747-48b3-a2b3-3c8c0e0c55c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:48.871781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90a81-4747-48b3-a2b3-3c8c0e0c55c4 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:48.872110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90a81-4747-48b3-a2b3-3c8c0e0c55c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:48.872402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d90a81-4747-48b3-a2b3-3c8c0e0c55c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:48.874465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-16d90a81-4747-48b3-a2b3-3c8c0e0c55c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:48.984896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90a81-4747-48b3-a2b3-3c8c0e0c55c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:48.986352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d90a81-4747-48b3-a2b3-3c8c0e0c55c4 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:49.023732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1129/2253] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:48 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:49.419029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:49.422080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:49.436509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4929-e4b8-48d0-abba-21740e73c8d5 service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:49.440560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:49.441656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:49.441917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:49.442206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:49.443881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:49.475158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:49.477367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:49.506727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1125/2254] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:49 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:57.779246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:57.779804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:57.779804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:57.801771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] MFA Rules not processed for user `bf2c93aa211c4587a97533f4b4e50b11`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:48:57.803097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:57.866637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1130/2255] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:48:57 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:48:58.180933 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:58.189492 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8140c73-c6b0-4a37-af8d-5c27d680f390 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:58.192991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:58.193556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:58.193847 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:58.194133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:58.195759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:58.206009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:58.207631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:58.218536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1126/2256] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:58 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:48:58.629187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:58.630567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:58.710555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005ddac-e495-425c-9c79-d6dc5f790250 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:58.715270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:58.715854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:58.716188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:58.716475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:58.718770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:58.729696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:58.731258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:58.740720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1131/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:58 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:48:58.843277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:48:58.844634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:58.858074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16928aa2-e7b8-4ea4-8ace-30b546aac000 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:48:58.863637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395abd62-2199-474d-a8c0-38bc53467983 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:48:58.864330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abd62-2199-474d-a8c0-38bc53467983 service placement] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:48:58.864699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abd62-2199-474d-a8c0-38bc53467983 service placement] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:48:58.865068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395abd62-2199-474d-a8c0-38bc53467983 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:48:58.866793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-395abd62-2199-474d-a8c0-38bc53467983 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:48:58.878511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395abd62-2199-474d-a8c0-38bc53467983 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:48:58.880141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395abd62-2199-474d-a8c0-38bc53467983 service placement] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:48:58.889740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1127/2258] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:48:58 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:01.000412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:01.013536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d1f49-855c-4275-a681-21c65cef8276 service placement] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:01.029912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b470a9-3ce4-45ff-b5a9-a46beeb7ecdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:01.032560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b470a9-3ce4-45ff-b5a9-a46beeb7ecdb service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:01.033066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b470a9-3ce4-45ff-b5a9-a46beeb7ecdb service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:01.039518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b470a9-3ce4-45ff-b5a9-a46beeb7ecdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:01.042462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c4b470a9-3ce4-45ff-b5a9-a46beeb7ecdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:01.065752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b470a9-3ce4-45ff-b5a9-a46beeb7ecdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:01.072376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b470a9-3ce4-45ff-b5a9-a46beeb7ecdb service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:01.090009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1132/2259] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:00 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:03.182897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90125-ee25-4aeb-8362-eec625bbde03 None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:03.183433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90125-ee25-4aeb-8362-eec625bbde03 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:03.183737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a90125-ee25-4aeb-8362-eec625bbde03 None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:03.185733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1128/2260] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:49:03.191803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d25c3-8b3f-4bda-89af-46bbe535cf65 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:03.192295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d25c3-8b3f-4bda-89af-46bbe535cf65 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:03.192404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d25c3-8b3f-4bda-89af-46bbe535cf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:03.252757 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-4e2d25c3-8b3f-4bda-89af-46bbe535cf65 None None] MFA Rules not processed for user `f724e05a70194ed992e73c9ca77eaef3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:03.253905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4e2d25c3-8b3f-4bda-89af-46bbe535cf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:03.262953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1133/2261] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:49:03 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:03.274458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90125-ee25-4aeb-8362-eec625bbde03 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:03.276089 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-59a90125-ee25-4aeb-8362-eec625bbde03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:03.341978 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a90125-ee25-4aeb-8362-eec625bbde03 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:03.345837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab831ed8-a00a-4269-ba77-c3768f906c97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:03.346432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab831ed8-a00a-4269-ba77-c3768f906c97 service glance] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:03.346721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab831ed8-a00a-4269-ba77-c3768f906c97 service glance] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:03.347012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab831ed8-a00a-4269-ba77-c3768f906c97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:03.357714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab831ed8-a00a-4269-ba77-c3768f906c97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:03.360909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab831ed8-a00a-4269-ba77-c3768f906c97 service glance] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:03.371598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1129/2262] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:03 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:03.466276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee706a3b-fe14-4aac-bcaf-801267c84cca None None] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:03.466574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee706a3b-fe14-4aac-bcaf-801267c84cca None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:03.466865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee706a3b-fe14-4aac-bcaf-801267c84cca None None] PATH_INFO: `/` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:03.468932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1134/2263] 10.222.0.23 () {54 vars in 921 bytes} [Fri Apr 8 02:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:49:03.475537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea54db6-f812-48ff-a052-d34e490290c5 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:03.476034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea54db6-f812-48ff-a052-d34e490290c5 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:03.476336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea54db6-f812-48ff-a052-d34e490290c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:03.524610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-0ea54db6-f812-48ff-a052-d34e490290c5 None None] MFA Rules not processed for user `865abd5c9d3b454ca1011e6e3111f580`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:03.525895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0ea54db6-f812-48ff-a052-d34e490290c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:03.541367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1130/2264] 10.222.0.23 () {58 vars in 1018 bytes} [Fri Apr 8 02:49:03 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:49:03.595140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee706a3b-fe14-4aac-bcaf-801267c84cca None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:03.609724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee706a3b-fe14-4aac-bcaf-801267c84cca None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:03.614286 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7333ef-6d43-4abf-8083-b949e4314fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:03.614869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7333ef-6d43-4abf-8083-b949e4314fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:03.615160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7333ef-6d43-4abf-8083-b949e4314fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:03.615446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7333ef-6d43-4abf-8083-b949e4314fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:03.623151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7333ef-6d43-4abf-8083-b949e4314fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:03.625096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7333ef-6d43-4abf-8083-b949e4314fc0 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:03.633976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1135/2265] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:03 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:06.978959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea54db6-f812-48ff-a052-d34e490290c5 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:06.988782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea54db6-f812-48ff-a052-d34e490290c5 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:06.993163 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:06.993952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:06.994249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:06.994679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:06.996625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:07.069767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:07.071376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:07.080764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1131/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:06 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:07.355199 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:07.355667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:07.355776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:07.381665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:07.382901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:07.390433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1136/2267] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:49:07 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:49:07.403118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:07.414514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c08cd70-7cdb-42cb-9707-ee3202d7a822 service glance] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:07.419204 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b884a-ba84-49d2-ab99-3a9592d3f0ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:07.419884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b884a-ba84-49d2-ab99-3a9592d3f0ec service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:07.420268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b884a-ba84-49d2-ab99-3a9592d3f0ec service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:07.420627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b884a-ba84-49d2-ab99-3a9592d3f0ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:07.429485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b884a-ba84-49d2-ab99-3a9592d3f0ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:07.431161 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b884a-ba84-49d2-ab99-3a9592d3f0ec service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:07.440552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1132/2268] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:49:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:49:47.211244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:47.213071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:47.229246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454804e-9377-4ae0-bbe1-59b08f2b347d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:47.235022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:47.235885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:47.236228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:47.236519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:47.238358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:47.250303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:47.252746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:47.263794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1137/2269] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:47 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:49:51.954409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:51.955001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:51.955161 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:51.977780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:49:51.978982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:51.985912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1133/2270] 10.222.0.23 () {58 vars in 967 bytes} [Fri Apr 8 02:49:51 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:49:52.008237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:52.018701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad9b66-2b73-4e56-a833-88e2438da18e service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:52.025220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:52.025837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:52.026130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:52.026627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:52.036309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:52.037880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:52.045617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1138/2271] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:49:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:49:59.596166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:49:59.598220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:59.614149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae9ab0-c055-42ff-a39e-10ad79d54008 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:49:59.621030 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:49:59.621611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:49:59.621900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:49:59.622188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:49:59.623858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:49:59.637447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:49:59.639670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:49:59.652672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1134/2272] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:49:59 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:22.237156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:22.248244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eaab3f-db98-4d86-85d8-00defae43f41 service swift] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:22.253373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:22.253938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:22.254228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:22.254510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:22.257090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:22.323822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:22.325498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:22.335170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1139/2273] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:22 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:28.328248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:28.338851 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d47be-526d-47ac-8089-110ceb5fbe04 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:28.344008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:28.344604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:28.344898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:28.345182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:28.346815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:28.412563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:28.414151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:28.422751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1135/2274] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:28 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:29.411488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:29.413033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:29.486938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b2044-bc83-4752-8f41-ad8e0adb650a service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:29.492480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:29.493431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:29.493731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:29.494022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] PATH_INFO: `/v3/users/bf2c93aa211c4587a97533f4b4e50b11` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:29.495157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2c93aa211c4587a97533f4b4e50b11)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:29.497356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:29.549372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2c93aa211c4587a97533f4b4e50b11'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.558126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2c93aa211c4587a97533f4b4e50b11'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.558810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2c93aa211c4587a97533f4b4e50b11'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.559417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2c93aa211c4587a97533f4b4e50b11'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.572581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-132dd1e9-0204-4dca-86da-0b8ccf4e71b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2c93aa211c4587a97533f4b4e50b11'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.585649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1140/2275] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:50:29 2022] DELETE /identity/v3/users/bf2c93aa211c4587a97533f4b4e50b11 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:29.813487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:29.824846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a790d29-b6cc-4828-a85a-5aa2045a0ed1 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:29.896776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:29.897615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:29.897963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:29.898198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] PATH_INFO: `/v3/projects/f648ffbed31f4192b6f16124451b3559` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:29.899516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f648ffbed31f4192b6f16124451b3559)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:29.901888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:29.960263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f648ffbed31f4192b6f16124451b3559', 'request_id': 'req-54f31f9f-f246-4b89-848e-39d3b422dcc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.965338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f648ffbed31f4192b6f16124451b3559', 'request_id': 'req-54f31f9f-f246-4b89-848e-39d3b422dcc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.974008 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f648ffbed31f4192b6f16124451b3559', 'request_id': 'req-54f31f9f-f246-4b89-848e-39d3b422dcc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.991447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] The token cache is being invalidate because project f648ffbed31f4192b6f16124451b3559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:50:29.991743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.992891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-54f31f9f-f246-4b89-848e-39d3b422dcc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:50:29.994118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1136/2276] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:50:29 2022] DELETE /identity/v3/projects/f648ffbed31f4192b6f16124451b3559 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:30.000733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33565-99c7-4dc3-bf4f-1cc589ca4377 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.001035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33565-99c7-4dc3-bf4f-1cc589ca4377 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.001325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb33565-99c7-4dc3-bf4f-1cc589ca4377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.025006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-fbb33565-99c7-4dc3-bf4f-1cc589ca4377 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:30.026191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-fbb33565-99c7-4dc3-bf4f-1cc589ca4377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:30.100610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1141/2277] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:50:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:30.108237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c4dd-0b69-4f22-a07d-6551c8644a2c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.109194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c4dd-0b69-4f22-a07d-6551c8644a2c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.109493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c4dd-0b69-4f22-a07d-6551c8644a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.136641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6ac9c4dd-0b69-4f22-a07d-6551c8644a2c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:30.137831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6ac9c4dd-0b69-4f22-a07d-6551c8644a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:30.150571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1137/2278] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:50:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:30.154806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33565-99c7-4dc3-bf4f-1cc589ca4377 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:30.165705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb33565-99c7-4dc3-bf4f-1cc589ca4377 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:30.170086 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:30.170668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.170957 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.171241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.172022 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:50:30.172326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:30.173971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:30.188418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1142/2279] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:50:30.193620 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c4dd-0b69-4f22-a07d-6551c8644a2c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:30.202709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c4dd-0b69-4f22-a07d-6551c8644a2c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:30.207256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:30.207978 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.208219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.208613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.209260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:30.211236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:30.258036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1138/2280] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:50:30 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:50:30.259170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:30.268793 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b79db-ce81-4b6a-8b12-2972f5c33323 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:30.334113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:30.334733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.335034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.335323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.335995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:30.337916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:30.358228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1143/2281] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:50:30 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:50:30.362411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:30.372377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dac706-4982-4046-bdf5-262265de2817 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:30.376736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:30.377324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.377622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.377911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.378613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:30.380800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:30.390677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1139/2282] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:50:30.394445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:30.405122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5f175-d2e6-4a2e-a07f-689c512220c8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:30.409385 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad1797-68c8-4e88-9bbb-f605f62c370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:30.409970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1797-68c8-4e88-9bbb-f605f62c370e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.410258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1797-68c8-4e88-9bbb-f605f62c370e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.410541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad1797-68c8-4e88-9bbb-f605f62c370e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.411811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1797-68c8-4e88-9bbb-f605f62c370e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:30.413417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad1797-68c8-4e88-9bbb-f605f62c370e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:30.423614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1144/2283] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:50:30.427762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:30.437799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367655e-3b26-406f-b517-0a4fd332258f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:30.442800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:30.443611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.444114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.444410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] PATH_INFO: `/v3/projects/0f7f360a7ebf4464b91dce9442330898/users/a0f675843ecb4ef2b4c1b450b6bacf88/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.463894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7f360a7ebf4464b91dce9442330898, user_id=a0f675843ecb4ef2b4c1b450b6bacf88, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:30.466546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:30.479917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1140/2284] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:50:30 2022] PUT /identity/v3/projects/0f7f360a7ebf4464b91dce9442330898/users/a0f675843ecb4ef2b4c1b450b6bacf88/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:50:30.484945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eec6f-0d29-47e6-90c1-6cb0e3efb839 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.485247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eec6f-0d29-47e6-90c1-6cb0e3efb839 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.485538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eec6f-0d29-47e6-90c1-6cb0e3efb839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.510180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-d08eec6f-0d29-47e6-90c1-6cb0e3efb839 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:30.511348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d08eec6f-0d29-47e6-90c1-6cb0e3efb839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:30.575913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1145/2285] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:50:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:30.586606 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:30.588276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:30.656854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75e9d-382a-42ec-9ee9-59cd9c54bc2c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:30.660244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:30.660905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:30.661226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:30.661605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:30.670414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:30.671840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:30.681279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1141/2286] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:50:37.704514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e873-84a0-439e-ae28-d9fe9b9dd2a8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:37.704979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e873-84a0-439e-ae28-d9fe9b9dd2a8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:37.705073 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759e873-84a0-439e-ae28-d9fe9b9dd2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:37.740164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2759e873-84a0-439e-ae28-d9fe9b9dd2a8 None None] MFA Rules not processed for user `a0f675843ecb4ef2b4c1b450b6bacf88`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:37.741333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2759e873-84a0-439e-ae28-d9fe9b9dd2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:37.814146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1146/2287] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:50:37 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:37.819431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:37.828540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f25a6-9a33-4706-b7ae-705fa6182c30 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:37.832999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:37.833653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:37.833867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:37.834138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:37.834784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:37.836686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:37.866353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1142/2288] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:50:37 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:50:37.870148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759e873-84a0-439e-ae28-d9fe9b9dd2a8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:37.881429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759e873-84a0-439e-ae28-d9fe9b9dd2a8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:37.949375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:37.949903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:37.950193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:37.950473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:37.951132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:37.953206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:37.976483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1147/2289] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:50:37 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:50:37.980248 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:37.993301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9b7d7-24fc-4bd5-8938-2eddb309e8d5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:37.998062 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:37.998820 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:37.999181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:37.999537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:38.000565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:38.002270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:38.014353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1143/2290] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:50:38.018649 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:38.029694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01192-725c-4716-b799-bd1d62ff810f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:38.034147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:38.035076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:38.036201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:38.036201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] PATH_INFO: `/v3/projects/e652bfd4bd0340bb99d09621eaade62b/users/9cf5779719404a6e8cda672a7d55a71e/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:38.057476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e652bfd4bd0340bb99d09621eaade62b, user_id=9cf5779719404a6e8cda672a7d55a71e, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:38.060406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:38.077246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1148/2291] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:50:38 2022] PUT /identity/v3/projects/e652bfd4bd0340bb99d09621eaade62b/users/9cf5779719404a6e8cda672a7d55a71e/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:50:38.080867 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:38.090792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7060-1df3-4668-ae30-6109134b5a8b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:38.157263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf42e6-fb59-4ade-ade1-0f05fb511c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:38.157779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf42e6-fb59-4ade-ade1-0f05fb511c3b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:38.158074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf42e6-fb59-4ade-ade1-0f05fb511c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:38.158364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf42e6-fb59-4ade-ade1-0f05fb511c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:38.159080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf42e6-fb59-4ade-ade1-0f05fb511c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:38.160776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf42e6-fb59-4ade-ade1-0f05fb511c3b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:38.171567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1144/2292] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:50:38.175759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:38.188527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329482b-9c81-4886-ab9c-6ab61913a31b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:38.193526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32ae67-2ada-4c64-86c8-ea8b9150e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:38.194371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ae67-2ada-4c64-86c8-ea8b9150e287 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:38.194650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ae67-2ada-4c64-86c8-ea8b9150e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:38.194941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32ae67-2ada-4c64-86c8-ea8b9150e287 admin admin] PATH_INFO: `/v3/projects/e652bfd4bd0340bb99d09621eaade62b/users/9cf5779719404a6e8cda672a7d55a71e/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:38.196803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32ae67-2ada-4c64-86c8-ea8b9150e287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e652bfd4bd0340bb99d09621eaade62b, user_id=9cf5779719404a6e8cda672a7d55a71e, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:38.199436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32ae67-2ada-4c64-86c8-ea8b9150e287 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:38.211189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1149/2293] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:50:38 2022] PUT /identity/v3/projects/e652bfd4bd0340bb99d09621eaade62b/users/9cf5779719404a6e8cda672a7d55a71e/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:50:41.626790 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:41.627339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:41.627339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:41.673965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] MFA Rules not processed for user `b3cc30404a3c4a16aff55c90e698e489`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:41.685474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:41.776967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1145/2294] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:50:41 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:45.139843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e90e71-55f5-4a23-9d00-aa07c03ef576 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:45.140609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e90e71-55f5-4a23-9d00-aa07c03ef576 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:45.140975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e90e71-55f5-4a23-9d00-aa07c03ef576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:45.177976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-e6e90e71-55f5-4a23-9d00-aa07c03ef576 None None] MFA Rules not processed for user `9cf5779719404a6e8cda672a7d55a71e`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:45.179425 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e6e90e71-55f5-4a23-9d00-aa07c03ef576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:45.259764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1150/2295] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:50:45 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:45.273032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:45.274555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:45.357504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac775a51-2867-46d5-82fd-ffe8ae548ee1 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:45.362594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:45.363181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:45.363508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:45.363830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:45.430323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:45.431918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:45.441247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1146/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:45 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:50:47.109288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3432af-21d2-48e7-8fdd-5dcd526d1e3a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:47.110094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3432af-21d2-48e7-8fdd-5dcd526d1e3a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:47.110523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3432af-21d2-48e7-8fdd-5dcd526d1e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:47.134865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6e3432af-21d2-48e7-8fdd-5dcd526d1e3a None None] MFA Rules not processed for user `a0f675843ecb4ef2b4c1b450b6bacf88`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:50:47.136375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6e3432af-21d2-48e7-8fdd-5dcd526d1e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:47.162082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1151/2297] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:50:47 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:50:49.127044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:50:49.141483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4467ebc-accb-457d-ae7d-a4cc9cbb6a7c service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:50:49.173926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b87021-1b72-4531-b7c4-24115adcb41c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:50:49.174542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b87021-1b72-4531-b7c4-24115adcb41c service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:50:49.174836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b87021-1b72-4531-b7c4-24115adcb41c service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:50:49.175120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b87021-1b72-4531-b7c4-24115adcb41c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:50:49.184066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-13b87021-1b72-4531-b7c4-24115adcb41c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:50:49.199728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b87021-1b72-4531-b7c4-24115adcb41c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:50:49.201394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b87021-1b72-4531-b7c4-24115adcb41c service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:50:49.221101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1147/2298] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:50:49 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:05.158405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3432af-21d2-48e7-8fdd-5dcd526d1e3a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:05.171197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3432af-21d2-48e7-8fdd-5dcd526d1e3a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:05.176307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:05.176885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:05.177173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:05.177485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:05.179422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:05.245869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:05.247499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:51:05.257157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1152/2299] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:05 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:14.063574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5134c-3d51-46ac-ad0e-0b24b3638e8b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:14.064136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5134c-3d51-46ac-ad0e-0b24b3638e8b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:14.064359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5134c-3d51-46ac-ad0e-0b24b3638e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:14.086873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f5e5134c-3d51-46ac-ad0e-0b24b3638e8b None None] MFA Rules not processed for user `e8e3c70e491a4f0691f753c8e2b95e95`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:51:14.088088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f5e5134c-3d51-46ac-ad0e-0b24b3638e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:14.152508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1148/2300] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:51:14 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:51:15.007231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:15.008717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:15.094955 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1b90-250d-41e0-a0a4-d8e371c4a7ce service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:15.098549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:15.099164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:15.099565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:15.100020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:15.102410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:15.112639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:15.114092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:51:15.122954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1153/2301] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:15 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:51:24.986577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:24.987109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:24.987214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:25.009812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] MFA Rules not processed for user `44a64fb1ebd9411eb6156c8ef97c3072`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:51:25.011132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:51:25.017388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1149/2302] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:51:24 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:51:33.623045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:51:33.631563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4115d-6ae8-4218-a429-9e6145d50b6c service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:51:33.634983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406eef2-05d5-4405-a0eb-087a858098b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:51:33.635570 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406eef2-05d5-4405-a0eb-087a858098b6 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:51:33.635858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406eef2-05d5-4405-a0eb-087a858098b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:51:33.636190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406eef2-05d5-4405-a0eb-087a858098b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:51:33.646482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406eef2-05d5-4405-a0eb-087a858098b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:51:33.647912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406eef2-05d5-4405-a0eb-087a858098b6 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:51:33.657064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1154/2303] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:51:33 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:02.177409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:02.178762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:02.255000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591e2d-d4b9-486d-9920-9b0af4e81fb8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:02.260187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:02.260780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:02.261076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:02.261366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:02.263183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:02.275096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:02.276750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:02.287384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1150/2304] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:02 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:06.846709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:06.847218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:06.847374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:06.869683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] MFA Rules not processed for user `008fc39c532a4a0ca8fc83e0d244a370`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:06.870861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:06.932779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1155/2305] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:06 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:15.866595 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:15.875822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f99823-4170-4eb8-8fb3-ac29fb30a5ab service placement] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:15.879312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:15.880021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:15.880339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:15.880629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:15.882330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:15.954113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:15.955552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:15.965343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1151/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:21.450603 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:21.452177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:21.468076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fb4d7-ce3b-4382-8079-10a1190c5081 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:21.474417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:21.475299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:21.475658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:21.476043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] PATH_INFO: `/v3/users/b3cc30404a3c4a16aff55c90e698e489` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:21.477246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3cc30404a3c4a16aff55c90e698e489)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:21.479239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:21.538525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3cc30404a3c4a16aff55c90e698e489'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.546220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3cc30404a3c4a16aff55c90e698e489'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.546895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3cc30404a3c4a16aff55c90e698e489'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.547509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3cc30404a3c4a16aff55c90e698e489'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.560086 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-f35095d6-4381-4760-9cdd-131fa35581a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3cc30404a3c4a16aff55c90e698e489'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.574333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1156/2307] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:21 2022] DELETE /identity/v3/users/b3cc30404a3c4a16aff55c90e698e489 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:21.801120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:21.811584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e7c92-033d-4cf8-bb56-2a3ede829754 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:21.885628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:21.886511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:21.886878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:21.887237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] PATH_INFO: `/v3/projects/bd1b3bd04ce44cd7893a53eb18d9a8b0` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:21.888461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1b3bd04ce44cd7893a53eb18d9a8b0)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:21.890426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:21.940470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'request_id': 'req-b817055e-697d-4f69-9793-74cb1a7777aa'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.946088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'request_id': 'req-b817055e-697d-4f69-9793-74cb1a7777aa'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.953447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1b3bd04ce44cd7893a53eb18d9a8b0', 'request_id': 'req-b817055e-697d-4f69-9793-74cb1a7777aa'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.970389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] The token cache is being invalidate because project bd1b3bd04ce44cd7893a53eb18d9a8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:21.970605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.971228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b817055e-697d-4f69-9793-74cb1a7777aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:21.972717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1152/2308] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:21 2022] DELETE /identity/v3/projects/bd1b3bd04ce44cd7893a53eb18d9a8b0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:21.979599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f441ab-7310-4008-b385-be341054124b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:21.979897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f441ab-7310-4008-b385-be341054124b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:21.980216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f441ab-7310-4008-b385-be341054124b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.003205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-59f441ab-7310-4008-b385-be341054124b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:22.005003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-59f441ab-7310-4008-b385-be341054124b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:22.074405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1157/2309] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:22.081745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8086e-04e1-4ce3-b690-0514521d57ed None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.082110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8086e-04e1-4ce3-b690-0514521d57ed None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.083006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8086e-04e1-4ce3-b690-0514521d57ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.105611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a8e8086e-04e1-4ce3-b690-0514521d57ed None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:22.106717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a8e8086e-04e1-4ce3-b690-0514521d57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:22.114742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1153/2310] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:22.118727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f441ab-7310-4008-b385-be341054124b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:22.128604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f441ab-7310-4008-b385-be341054124b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:22.133621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:22.134204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.134495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.134779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.135473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:52:22.135775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:22.137387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:22.149965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1158/2311] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:22.154388 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8086e-04e1-4ce3-b690-0514521d57ed None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:22.163803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8086e-04e1-4ce3-b690-0514521d57ed None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:22.168502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:22.169123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.169417 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.169707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.170422 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:22.172411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:22.202631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1154/2312] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:22 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:22.206641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:22.216824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124703b-a61a-483d-930a-0076fc4cf4ad admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:22.282036 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:22.282912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.283369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.283655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.284343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:22.286424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:22.307713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1159/2313] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:22 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:22.311688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:22.322509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110fe1a-c659-42d8-b200-bf2f1f731081 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:22.327432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:22.328145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.328569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.328859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.329562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:22.331173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:22.342002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1155/2314] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:22.346163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:22.355989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46123b74-5885-48b3-b23e-90552ac7c61d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:22.360477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8de3-3f1b-46ff-96e3-cdca8832ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:22.361164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8de3-3f1b-46ff-96e3-cdca8832ae8a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.361526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8de3-3f1b-46ff-96e3-cdca8832ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.361881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8de3-3f1b-46ff-96e3-cdca8832ae8a admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.362652 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8de3-3f1b-46ff-96e3-cdca8832ae8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:22.364837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c8de3-3f1b-46ff-96e3-cdca8832ae8a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:22.374954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1160/2315] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:22.379138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:22.389396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9aed9-222b-400b-b6f8-91102871cf80 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:22.393770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:22.394578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.394928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.395351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] PATH_INFO: `/v3/projects/31b4606e4c8a4c1e8b9aece71480cdea/users/d742210abb6d40b8acaae392c3698342/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.414555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31b4606e4c8a4c1e8b9aece71480cdea, user_id=d742210abb6d40b8acaae392c3698342, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:22.417325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:22.432644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1156/2316] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:22 2022] PUT /identity/v3/projects/31b4606e4c8a4c1e8b9aece71480cdea/users/d742210abb6d40b8acaae392c3698342/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:22.444665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0667e-36bc-4fa7-9696-9cb9d3d2a60d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.445182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0667e-36bc-4fa7-9696-9cb9d3d2a60d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.445551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0667e-36bc-4fa7-9696-9cb9d3d2a60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.482850 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-31c0667e-36bc-4fa7-9696-9cb9d3d2a60d None None] MFA Rules not processed for user `d742210abb6d40b8acaae392c3698342`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:22.484056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-31c0667e-36bc-4fa7-9696-9cb9d3d2a60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:22.558215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1161/2317] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:22 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:22.568301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:22.570034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:22.633482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76160462-368b-4be8-aab1-96eb5e880a2b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:22.636959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86279140-3a1a-4b26-afc4-36b737219dc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:22.637554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279140-3a1a-4b26-afc4-36b737219dc8 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:22.637831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279140-3a1a-4b26-afc4-36b737219dc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:22.638115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86279140-3a1a-4b26-afc4-36b737219dc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:22.646727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86279140-3a1a-4b26-afc4-36b737219dc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:22.648180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86279140-3a1a-4b26-afc4-36b737219dc8 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:22.657074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1157/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:22 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:31.890920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0667e-36bc-4fa7-9696-9cb9d3d2a60d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:31.960309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0667e-36bc-4fa7-9696-9cb9d3d2a60d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:31.964479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:31.965270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:31.965559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:31.965842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] PATH_INFO: `/v3/users/d742210abb6d40b8acaae392c3698342` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:31.966944 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d742210abb6d40b8acaae392c3698342)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:31.968870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:32.016697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd742210abb6d40b8acaae392c3698342'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.024606 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd742210abb6d40b8acaae392c3698342'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.025253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd742210abb6d40b8acaae392c3698342'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.025842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd742210abb6d40b8acaae392c3698342'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.037843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd742210abb6d40b8acaae392c3698342'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.049392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1162/2319] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:31 2022] DELETE /identity/v3/users/d742210abb6d40b8acaae392c3698342 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:32.054793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.055611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.055611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.077537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:32.078703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:32.141780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1158/2320] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:32.152013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:32.153352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:32.218857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c05b2-7fb8-422d-821d-a946e889cfb0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:32.222307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c85552-cc05-48c7-9e0f-3911e1b46e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:32.222882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85552-cc05-48c7-9e0f-3911e1b46e60 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.223171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85552-cc05-48c7-9e0f-3911e1b46e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.223454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c85552-cc05-48c7-9e0f-3911e1b46e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.233462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85552-cc05-48c7-9e0f-3911e1b46e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:32.234886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c85552-cc05-48c7-9e0f-3911e1b46e60 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:32.244051 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1163/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:32.587745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:32.589145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:32.601542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b34dc-d838-4de6-874f-87a6ed87878e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:32.605831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:32.606611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.606903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.607190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] PATH_INFO: `/v3/projects/31b4606e4c8a4c1e8b9aece71480cdea` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.608313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31b4606e4c8a4c1e8b9aece71480cdea)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:32.610211 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:32.659389 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31b4606e4c8a4c1e8b9aece71480cdea', 'request_id': 'req-cc7130cc-fdf6-4423-abd5-fa475aefb43f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.664497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31b4606e4c8a4c1e8b9aece71480cdea', 'request_id': 'req-cc7130cc-fdf6-4423-abd5-fa475aefb43f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.672081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31b4606e4c8a4c1e8b9aece71480cdea', 'request_id': 'req-cc7130cc-fdf6-4423-abd5-fa475aefb43f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.688442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] The token cache is being invalidate because project 31b4606e4c8a4c1e8b9aece71480cdea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:32.688732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.689354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-cc7130cc-fdf6-4423-abd5-fa475aefb43f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:32.690770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1159/2322] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:32 2022] DELETE /identity/v3/projects/31b4606e4c8a4c1e8b9aece71480cdea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:32.696732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd45d-8750-4e5f-84be-60075d179f40 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.697027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd45d-8750-4e5f-84be-60075d179f40 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.697311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd45d-8750-4e5f-84be-60075d179f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.719068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a56bd45d-8750-4e5f-84be-60075d179f40 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:32.720239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a56bd45d-8750-4e5f-84be-60075d179f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:32.783224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1164/2323] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:32.790780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba7d9-cc0f-42cf-9fac-4e71c9687bfd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.791084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba7d9-cc0f-42cf-9fac-4e71c9687bfd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.791376 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cba7d9-cc0f-42cf-9fac-4e71c9687bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.814444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c9cba7d9-cc0f-42cf-9fac-4e71c9687bfd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:32.815827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c9cba7d9-cc0f-42cf-9fac-4e71c9687bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:32.824272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1160/2324] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:32.828420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd45d-8750-4e5f-84be-60075d179f40 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:32.838042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd45d-8750-4e5f-84be-60075d179f40 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:32.842273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:32.842852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.843139 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.843422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.844142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:52:32.844442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:32.846127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:32.858913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1165/2325] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:32.863104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cba7d9-cc0f-42cf-9fac-4e71c9687bfd None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:32.872362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cba7d9-cc0f-42cf-9fac-4e71c9687bfd None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:32.876693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:32.877272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.877563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.877848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.878499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:32.881024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:32.906014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1161/2326] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:32 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:32.910007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:32.919511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0d165-6904-4cc0-b81a-0728d7731622 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:32.982398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:32.982932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:32.983228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:32.983518 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:32.984190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:32.986097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.005320 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1166/2327] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:32 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:33.009781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.019491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497f10d-1857-4950-998a-552d60d999bf admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.024309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.024894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.025183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.025465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.026158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.027717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.038725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1162/2328] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:52:33.042660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.052062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c703c-efbf-46e1-a9dc-7a4a2b34bd3e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.057278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d86a7e-e89a-4e67-92b2-72bff1c23b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.057857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d86a7e-e89a-4e67-92b2-72bff1c23b91 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.058143 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d86a7e-e89a-4e67-92b2-72bff1c23b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.058426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d86a7e-e89a-4e67-92b2-72bff1c23b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.059160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d86a7e-e89a-4e67-92b2-72bff1c23b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.060755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d86a7e-e89a-4e67-92b2-72bff1c23b91 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.070506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1167/2329] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:52:33.074360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.084295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409141f5-cdcf-4367-808c-903bb37b1a91 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.088601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.089399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.089685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.089967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] PATH_INFO: `/v3/projects/697b2a38b1f646d1bddca479827da125/users/4eb0261ba3d64e77ad9a1ae13a076069/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.109247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697b2a38b1f646d1bddca479827da125, user_id=4eb0261ba3d64e77ad9a1ae13a076069, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.111886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.124842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1163/2330] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:33 2022] PUT /identity/v3/projects/697b2a38b1f646d1bddca479827da125/users/4eb0261ba3d64e77ad9a1ae13a076069/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:33.135417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0a5cd-7bd6-4d18-bfd1-4756933c4c4b None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.135713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0a5cd-7bd6-4d18-bfd1-4756933c4c4b None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.136065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0a5cd-7bd6-4d18-bfd1-4756933c4c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.171421 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c0c0a5cd-7bd6-4d18-bfd1-4756933c4c4b None None] MFA Rules not processed for user `4eb0261ba3d64e77ad9a1ae13a076069`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:33.172595 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c0c0a5cd-7bd6-4d18-bfd1-4756933c4c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:33.243457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1168/2331] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:33 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:33.248006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.316548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1302f-c02e-4a28-870f-ec2e577b46d6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.321167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.321755 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.322048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.322337 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.323026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.324999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.351308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1164/2332] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:33 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:33.355368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0a5cd-7bd6-4d18-bfd1-4756933c4c4b None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.365730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0a5cd-7bd6-4d18-bfd1-4756933c4c4b None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.429901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.430770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.431088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.431376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.432043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.433956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.456175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1169/2333] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:33 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:33.457435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.468177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134dd99-e300-4ad0-bd6f-2c790777bbec admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.472593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.473244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.473599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.474586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.475404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.477071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.487414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1165/2334] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:33.491640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.501546 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4447f07-02ad-460f-9134-1bcb2ba1b1b0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.505783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.506625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.506916 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.507205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] PATH_INFO: `/v3/projects/ec91c01d37a44b48b4544db8bc80c744/users/b0aea4d656604c6bb612495637ff45e5/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.527132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec91c01d37a44b48b4544db8bc80c744, user_id=b0aea4d656604c6bb612495637ff45e5, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.529785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.543683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1170/2335] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:33 2022] PUT /identity/v3/projects/ec91c01d37a44b48b4544db8bc80c744/users/b0aea4d656604c6bb612495637ff45e5/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:33.547954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.557733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cf9ca-d92d-43a9-84bd-943bec02d757 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.620264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7c1fd-cb54-4984-9d19-5d4ba98201cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.620866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7c1fd-cb54-4984-9d19-5d4ba98201cf admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.621159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7c1fd-cb54-4984-9d19-5d4ba98201cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.621443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7c1fd-cb54-4984-9d19-5d4ba98201cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.622145 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7c1fd-cb54-4984-9d19-5d4ba98201cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.623724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7c1fd-cb54-4984-9d19-5d4ba98201cf admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.633528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1166/2336] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:33.637762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.648668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847cd20-72a8-42a0-aa3d-0831296a3327 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.652979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.653762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.654045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.654324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] PATH_INFO: `/v3/projects/ec91c01d37a44b48b4544db8bc80c744/users/b0aea4d656604c6bb612495637ff45e5/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.656118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec91c01d37a44b48b4544db8bc80c744, user_id=b0aea4d656604c6bb612495637ff45e5, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.658684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.669361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1171/2337] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:33 2022] PUT /identity/v3/projects/ec91c01d37a44b48b4544db8bc80c744/users/b0aea4d656604c6bb612495637ff45e5/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:33.681219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676590e-7a35-4316-aefd-4f39b42f6e22 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.681568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676590e-7a35-4316-aefd-4f39b42f6e22 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.681861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676590e-7a35-4316-aefd-4f39b42f6e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.720278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b676590e-7a35-4316-aefd-4f39b42f6e22 None None] MFA Rules not processed for user `b0aea4d656604c6bb612495637ff45e5`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:33.721459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b676590e-7a35-4316-aefd-4f39b42f6e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:33.795864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1167/2338] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:33 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:33.806263 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:33.807895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:33.872160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340a2c3-cb84-484a-9e8e-1f670894e9c2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:33.875607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:33.876207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:33.876494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:33.876773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:33.886363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:33.887778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:33.897754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1172/2339] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:33 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:33.994154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676590e-7a35-4316-aefd-4f39b42f6e22 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:34.003446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676590e-7a35-4316-aefd-4f39b42f6e22 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:34.007400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d29fe3-dc9c-4a4c-9f72-1b43730fbde8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:34.007995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29fe3-dc9c-4a4c-9f72-1b43730fbde8 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:34.008286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29fe3-dc9c-4a4c-9f72-1b43730fbde8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:34.008590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d29fe3-dc9c-4a4c-9f72-1b43730fbde8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:34.071001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29fe3-dc9c-4a4c-9f72-1b43730fbde8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:34.072414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d29fe3-dc9c-4a4c-9f72-1b43730fbde8 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:34.080759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1168/2340] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:33 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:45.388894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.456416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e5a89-5706-4948-8dae-b378af759319 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.461423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.462220 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.462513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.462797 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] PATH_INFO: `/v3/users/4eb0261ba3d64e77ad9a1ae13a076069` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.463898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eb0261ba3d64e77ad9a1ae13a076069)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.465831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:45.513174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eb0261ba3d64e77ad9a1ae13a076069'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:45.520665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eb0261ba3d64e77ad9a1ae13a076069'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:45.521322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eb0261ba3d64e77ad9a1ae13a076069'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:45.522481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eb0261ba3d64e77ad9a1ae13a076069'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:45.533815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eb0261ba3d64e77ad9a1ae13a076069'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:45.547885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1173/2341] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:45 2022] DELETE /identity/v3/users/4eb0261ba3d64e77ad9a1ae13a076069 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:45.552356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.552898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.553020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.575181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:45.576369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:45.643547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1169/2342] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:45.654938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:45.656365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:45.720905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def976b3-8539-45b3-9b15-40cd5c8fa72d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:45.724555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:45.725614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:45.725922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:45.726210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:45.735043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:45.736491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:45.745883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1174/2343] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:46.095005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.096434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:46.107683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885151c2-b17f-4cc7-b0f4-2ffb710d5e96 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.112048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.112834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.113131 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.113420 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] PATH_INFO: `/v3/projects/697b2a38b1f646d1bddca479827da125` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.114521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=697b2a38b1f646d1bddca479827da125)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.116951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:46.166688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697b2a38b1f646d1bddca479827da125', 'request_id': 'req-97503c0c-9365-4edc-9587-584a05c9a34c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.171640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697b2a38b1f646d1bddca479827da125', 'request_id': 'req-97503c0c-9365-4edc-9587-584a05c9a34c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.178690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697b2a38b1f646d1bddca479827da125', 'request_id': 'req-97503c0c-9365-4edc-9587-584a05c9a34c'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.200880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] The token cache is being invalidate because project 697b2a38b1f646d1bddca479827da125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:46.201166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.201796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.203251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1170/2344] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:46 2022] DELETE /identity/v3/projects/697b2a38b1f646d1bddca479827da125 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:46.207409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.218114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a32858-443f-4d6b-bde7-78c0094c0fc1 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.284753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.285552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.285844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.286131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] PATH_INFO: `/v3/users/b0aea4d656604c6bb612495637ff45e5` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.287264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0aea4d656604c6bb612495637ff45e5)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.289180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:46.336003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0aea4d656604c6bb612495637ff45e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.343424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0aea4d656604c6bb612495637ff45e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.344194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0aea4d656604c6bb612495637ff45e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.344800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0aea4d656604c6bb612495637ff45e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.356488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49415338-ca82-4d1e-9964-e1045919112b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0aea4d656604c6bb612495637ff45e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.369019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1175/2345] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:46 2022] DELETE /identity/v3/users/b0aea4d656604c6bb612495637ff45e5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:46.723485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:46.725435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:46.738609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97503c0c-9365-4edc-9587-584a05c9a34c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:46.800838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:46.801556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.801852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.802139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] PATH_INFO: `/v3/projects/ec91c01d37a44b48b4544db8bc80c744` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.803862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec91c01d37a44b48b4544db8bc80c744)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:46.806041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:46.861272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec91c01d37a44b48b4544db8bc80c744', 'request_id': 'req-958bf429-8473-4e5e-a88c-f113b96a7e5b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.866243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec91c01d37a44b48b4544db8bc80c744', 'request_id': 'req-958bf429-8473-4e5e-a88c-f113b96a7e5b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.872667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec91c01d37a44b48b4544db8bc80c744', 'request_id': 'req-958bf429-8473-4e5e-a88c-f113b96a7e5b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.888507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] The token cache is being invalidate because project ec91c01d37a44b48b4544db8bc80c744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:46.888796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.889418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-958bf429-8473-4e5e-a88c-f113b96a7e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:46.890884 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1171/2346] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:46 2022] DELETE /identity/v3/projects/ec91c01d37a44b48b4544db8bc80c744 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:46.895856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a092-f545-40fd-8861-f095d6f66223 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.896374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a092-f545-40fd-8861-f095d6f66223 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.897040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55a092-f545-40fd-8861-f095d6f66223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:46.920174 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-de55a092-f545-40fd-8861-f095d6f66223 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:46.921308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-de55a092-f545-40fd-8861-f095d6f66223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:46.986928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1176/2347] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:46.995189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1b0c-9f7a-4e57-a6c9-aa7ad472b5b3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:46.995488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1b0c-9f7a-4e57-a6c9-aa7ad472b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:46.995808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca1b0c-9f7a-4e57-a6c9-aa7ad472b5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.017566 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-37ca1b0c-9f7a-4e57-a6c9-aa7ad472b5b3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:47.018713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-37ca1b0c-9f7a-4e57-a6c9-aa7ad472b5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:47.026527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1172/2348] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:47.030562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a092-f545-40fd-8861-f095d6f66223 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.040276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55a092-f545-40fd-8861-f095d6f66223 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.044533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.045109 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.045397 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.045680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.046367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:52:47.046664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.048261 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.061628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1177/2349] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:47.065625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca1b0c-9f7a-4e57-a6c9-aa7ad472b5b3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.074998 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca1b0c-9f7a-4e57-a6c9-aa7ad472b5b3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.079362 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.079947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.080262 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.080549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.081183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.083068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.109143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1173/2350] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:47 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:47.113400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.123645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acf640-b6a3-4b3b-ab9a-64a75e5025d6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.187433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.188052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.188342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.188626 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.189264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.191203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.211705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1178/2351] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:47 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:47.215875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.226312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb8c20-7187-46f2-b6ee-18c789c922d7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.230701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a335753-c113-4150-8964-32517930efbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.231269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a335753-c113-4150-8964-32517930efbc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.231563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a335753-c113-4150-8964-32517930efbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.231870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a335753-c113-4150-8964-32517930efbc admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.232683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a335753-c113-4150-8964-32517930efbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.234271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a335753-c113-4150-8964-32517930efbc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.245020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1174/2352] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:47.248644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.259463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f8d6f-0df5-4dc6-9de4-a9d28e6565bc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.264439 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fc6cb-b7f0-4211-aee1-6f71e0d90b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.265029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc6cb-b7f0-4211-aee1-6f71e0d90b50 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.265404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc6cb-b7f0-4211-aee1-6f71e0d90b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.265685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fc6cb-b7f0-4211-aee1-6f71e0d90b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.266378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fc6cb-b7f0-4211-aee1-6f71e0d90b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.268004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fc6cb-b7f0-4211-aee1-6f71e0d90b50 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.278294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1179/2353] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:47.282379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a335753-c113-4150-8964-32517930efbc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.293123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a335753-c113-4150-8964-32517930efbc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.297457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.298268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.298555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.298861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] PATH_INFO: `/v3/projects/bfe56a53ca2a43a8b58357ea95d8626b/users/6b3f0a9f427c4f85966c93c1e5fe1010/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.318447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe56a53ca2a43a8b58357ea95d8626b, user_id=6b3f0a9f427c4f85966c93c1e5fe1010, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.321042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.332832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1175/2354] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:47 2022] PUT /identity/v3/projects/bfe56a53ca2a43a8b58357ea95d8626b/users/6b3f0a9f427c4f85966c93c1e5fe1010/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:47.342746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956c85-3c04-47eb-a0e6-c453ce32d151 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.343033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956c85-3c04-47eb-a0e6-c453ce32d151 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.343318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0956c85-3c04-47eb-a0e6-c453ce32d151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.379361 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-d0956c85-3c04-47eb-a0e6-c453ce32d151 None None] MFA Rules not processed for user `6b3f0a9f427c4f85966c93c1e5fe1010`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:47.380545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d0956c85-3c04-47eb-a0e6-c453ce32d151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:47.453090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1180/2355] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:47.457533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.527548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a632-555e-45fe-af1c-c38d2c18cd4b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.531908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.532516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.532805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.533087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.533727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.535746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.563400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1176/2356] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:47 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:47.567347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956c85-3c04-47eb-a0e6-c453ce32d151 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.577964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0956c85-3c04-47eb-a0e6-c453ce32d151 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.641201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.641804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.642096 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.642382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.643030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.645006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.663943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1181/2357] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:47 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:47.668078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.677835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0d651-c566-431a-b38f-b8ec5a78ec54 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.682562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.683152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.683443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.683733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.684475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.686153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.696964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1177/2358] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:47.700945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.711140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc311433-df59-4171-9402-11a56b21d612 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.715531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.716388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.716684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.716974 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] PATH_INFO: `/v3/projects/b255769c99a94c0888811445257b384e/users/d6867f7f0d2c43ac9290a8a77068e299/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.736466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b255769c99a94c0888811445257b384e, user_id=d6867f7f0d2c43ac9290a8a77068e299, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.739081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.751996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1182/2359] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:47 2022] PUT /identity/v3/projects/b255769c99a94c0888811445257b384e/users/d6867f7f0d2c43ac9290a8a77068e299/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:47.756114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.765613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e211aa3-aaf9-40a9-ac06-224fbff50ac9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.827529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ac71e-d8a7-40e4-9383-9eb0169d9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.828217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ac71e-d8a7-40e4-9383-9eb0169d9185 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.828460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ac71e-d8a7-40e4-9383-9eb0169d9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.828749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ac71e-d8a7-40e4-9383-9eb0169d9185 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.829451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ac71e-d8a7-40e4-9383-9eb0169d9185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.831069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ac71e-d8a7-40e4-9383-9eb0169d9185 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.841432 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1178/2360] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:47.845490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:47.855823 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64b76-5543-4079-8fcc-e7a30539e429 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:47.860396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:47.861204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.861496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.861779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] PATH_INFO: `/v3/projects/b255769c99a94c0888811445257b384e/users/d6867f7f0d2c43ac9290a8a77068e299/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.863585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b255769c99a94c0888811445257b384e, user_id=d6867f7f0d2c43ac9290a8a77068e299, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:47.866366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:47.876202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1183/2361] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:47 2022] PUT /identity/v3/projects/b255769c99a94c0888811445257b384e/users/d6867f7f0d2c43ac9290a8a77068e299/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:47.887025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8918-c1dc-41aa-80a4-3c45f63ff6bf None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:47.887321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8918-c1dc-41aa-80a4-3c45f63ff6bf None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:47.887614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a8918-c1dc-41aa-80a4-3c45f63ff6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:47.923363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-0d5a8918-c1dc-41aa-80a4-3c45f63ff6bf None None] MFA Rules not processed for user `d6867f7f0d2c43ac9290a8a77068e299`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:47.924562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0d5a8918-c1dc-41aa-80a4-3c45f63ff6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:47.998839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1179/2362] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:48.009433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:48.011069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:48.074350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf60cd-85cc-4550-abc1-fb53684d08f6 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:48.077874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c675-1260-43c3-9477-3ec080cb5094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:48.078504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c675-1260-43c3-9477-3ec080cb5094 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:48.078742 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c675-1260-43c3-9477-3ec080cb5094 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:48.079028 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c675-1260-43c3-9477-3ec080cb5094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:48.088355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5c675-1260-43c3-9477-3ec080cb5094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:48.089785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5c675-1260-43c3-9477-3ec080cb5094 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:48.098635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1184/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:48 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:48.559883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8918-c1dc-41aa-80a4-3c45f63ff6bf None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:48.628624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a8918-c1dc-41aa-80a4-3c45f63ff6bf None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:48.633664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:48.634466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:48.634759 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:48.635049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] PATH_INFO: `/v3/users/6b3f0a9f427c4f85966c93c1e5fe1010` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:48.636213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3f0a9f427c4f85966c93c1e5fe1010)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:48.638122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:48.686994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3f0a9f427c4f85966c93c1e5fe1010'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.687633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3f0a9f427c4f85966c93c1e5fe1010'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.699455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3f0a9f427c4f85966c93c1e5fe1010'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.700111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3f0a9f427c4f85966c93c1e5fe1010'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.707526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3f0a9f427c4f85966c93c1e5fe1010'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:48.719738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1180/2364] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:48 2022] DELETE /identity/v3/users/6b3f0a9f427c4f85966c93c1e5fe1010 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:48.724171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:48.724500 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:48.725414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:48.747507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:48.748702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:48.812447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1185/2365] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:48.823041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:48.824407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:48.890232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f2211-8087-4ddb-b205-ae60f0aa1805 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:48.893652 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:48.894232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:48.894523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:48.894807 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:48.903575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:48.905048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:48.914441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1181/2366] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:49.264941 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.266334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:49.278450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b77d4-5181-438b-b5d0-c0b4e6914a04 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.282808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.283592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.283879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.284191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] PATH_INFO: `/v3/projects/bfe56a53ca2a43a8b58357ea95d8626b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.285292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe56a53ca2a43a8b58357ea95d8626b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.287822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:49.337253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe56a53ca2a43a8b58357ea95d8626b', 'request_id': 'req-aa9c50d0-4588-4eef-b357-8e242a39f57e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.343913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe56a53ca2a43a8b58357ea95d8626b', 'request_id': 'req-aa9c50d0-4588-4eef-b357-8e242a39f57e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.355686 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe56a53ca2a43a8b58357ea95d8626b', 'request_id': 'req-aa9c50d0-4588-4eef-b357-8e242a39f57e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.365917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] The token cache is being invalidate because project bfe56a53ca2a43a8b58357ea95d8626b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:49.366268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.366899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.368406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1186/2367] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:49 2022] DELETE /identity/v3/projects/bfe56a53ca2a43a8b58357ea95d8626b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:49.372348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.381609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e06b2d-1fc4-4b4d-9dec-1d11bb69edc2 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.445817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.446539 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.446836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.447124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] PATH_INFO: `/v3/users/d6867f7f0d2c43ac9290a8a77068e299` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.448272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6867f7f0d2c43ac9290a8a77068e299)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.450171 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:49.498581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6867f7f0d2c43ac9290a8a77068e299'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.499253 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6867f7f0d2c43ac9290a8a77068e299'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.511706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6867f7f0d2c43ac9290a8a77068e299'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.512404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6867f7f0d2c43ac9290a8a77068e299'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.519846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-573ab3d5-70bf-48ae-abd1-f380bd15af50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6867f7f0d2c43ac9290a8a77068e299'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:49.536224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1182/2368] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:49 2022] DELETE /identity/v3/users/d6867f7f0d2c43ac9290a8a77068e299 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:49.886813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:49.888218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:49.904007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c50d0-4588-4eef-b357-8e242a39f57e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:49.970529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:49.971269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:49.971610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:49.971873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] PATH_INFO: `/v3/projects/b255769c99a94c0888811445257b384e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:49.973023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b255769c99a94c0888811445257b384e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:49.975029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.022945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b255769c99a94c0888811445257b384e', 'request_id': 'req-692256d2-e98e-4777-9636-d9eecbe6d3fa'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:50.029463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b255769c99a94c0888811445257b384e', 'request_id': 'req-692256d2-e98e-4777-9636-d9eecbe6d3fa'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:50.041621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b255769c99a94c0888811445257b384e', 'request_id': 'req-692256d2-e98e-4777-9636-d9eecbe6d3fa'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:50.051586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] The token cache is being invalidate because project b255769c99a94c0888811445257b384e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:50.051872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:50.052562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-692256d2-e98e-4777-9636-d9eecbe6d3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:50.054191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1187/2369] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:49 2022] DELETE /identity/v3/projects/b255769c99a94c0888811445257b384e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:50.059272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e88b8-5c90-40d9-8fe0-c6f95ac47f6e None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.059747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e88b8-5c90-40d9-8fe0-c6f95ac47f6e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.059849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e88b8-5c90-40d9-8fe0-c6f95ac47f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.081796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-cb9e88b8-5c90-40d9-8fe0-c6f95ac47f6e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:50.082973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-cb9e88b8-5c90-40d9-8fe0-c6f95ac47f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:50.146358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1183/2370] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:50.156054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11a9bb-63b4-40f3-ad33-07d297ce6e77 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.156353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11a9bb-63b4-40f3-ad33-07d297ce6e77 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.156645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11a9bb-63b4-40f3-ad33-07d297ce6e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.181758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6c11a9bb-63b4-40f3-ad33-07d297ce6e77 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:50.182924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6c11a9bb-63b4-40f3-ad33-07d297ce6e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:50.190110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1188/2371] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:50.195198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e88b8-5c90-40d9-8fe0-c6f95ac47f6e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.204384 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e88b8-5c90-40d9-8fe0-c6f95ac47f6e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.208689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.210383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.210672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.210960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.211651 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:52:50.211983 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.213553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.227026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1184/2372] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:52:50.230982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11a9bb-63b4-40f3-ad33-07d297ce6e77 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.239620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11a9bb-63b4-40f3-ad33-07d297ce6e77 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.255003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.255593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.255950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.256293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.256993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.258871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.285350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1189/2373] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:50.290299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.299901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a697b-f8b1-4dd4-bec6-4e803ee4fd73 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.361169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.361769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.362063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.362352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.362993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.364981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.384507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1185/2374] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:50.388625 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.398852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9c16-db04-404c-b88f-cf95ed858feb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.403180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.403762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.404089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.404371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.405061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.406628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.417091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1190/2375] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:50.420745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.431113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f919b0-9150-410a-bb30-aed39df9a99c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.435723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4b8ea-d1d6-49ff-bba1-041c9026f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.436578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b8ea-d1d6-49ff-bba1-041c9026f6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.437052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b8ea-d1d6-49ff-bba1-041c9026f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.437348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4b8ea-d1d6-49ff-bba1-041c9026f6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.438054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4b8ea-d1d6-49ff-bba1-041c9026f6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.439678 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4b8ea-d1d6-49ff-bba1-041c9026f6a0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.450049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1186/2376] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:50.454131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.464452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fdcbb-046f-43d3-ad01-03c6efadb18f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.468867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.469676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.469966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.470253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] PATH_INFO: `/v3/projects/5949ca1e77904462b90eed55004be0ad/users/66619be998d64f8799c8918950076f56/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.489677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5949ca1e77904462b90eed55004be0ad, user_id=66619be998d64f8799c8918950076f56, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.492933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.507442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1191/2377] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:50 2022] PUT /identity/v3/projects/5949ca1e77904462b90eed55004be0ad/users/66619be998d64f8799c8918950076f56/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:50.518619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475339-3c5c-4438-b20c-a37e394884c2 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.518919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475339-3c5c-4438-b20c-a37e394884c2 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.519209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42475339-3c5c-4438-b20c-a37e394884c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.556879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-42475339-3c5c-4438-b20c-a37e394884c2 None None] MFA Rules not processed for user `66619be998d64f8799c8918950076f56`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:50.558041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-42475339-3c5c-4438-b20c-a37e394884c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:50.629280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1187/2378] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:50.633748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.702707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79703d66-4e6a-4057-8511-f707f32f3b63 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.707020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.707607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.707896 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.708210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.709554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.711725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.737875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1192/2379] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:50.742131 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475339-3c5c-4438-b20c-a37e394884c2 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.752566 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42475339-3c5c-4438-b20c-a37e394884c2 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.814346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.814943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.815259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.815541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.816202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.818098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.837849 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1188/2380] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:50 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:50.841946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.852561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99812d9-ddf8-4bc9-a0d5-e657308cf3ab admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.856946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.857534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.857826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.858112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.858812 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.860432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.871190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1193/2381] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:50.875381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.885185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c95c8-7425-4010-94c1-f13f8e36b584 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:50.889636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:50.890446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:50.890741 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:50.891032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] PATH_INFO: `/v3/projects/237164960e16400bb0c3fbdf7d74cea8/users/a4100c3902a740728dc54bb19ada9bc1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:50.910780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=237164960e16400bb0c3fbdf7d74cea8, user_id=a4100c3902a740728dc54bb19ada9bc1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:50.914444 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:50.926917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1189/2382] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:50 2022] PUT /identity/v3/projects/237164960e16400bb0c3fbdf7d74cea8/users/a4100c3902a740728dc54bb19ada9bc1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:50.931318 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:50.940885 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dc29f-7f47-48a1-b8d5-6fa3b996aa6b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:51.015334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95945576-e0fc-4bd3-bd15-be4d9ce0ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:51.015844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945576-e0fc-4bd3-bd15-be4d9ce0ff09 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:51.016164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945576-e0fc-4bd3-bd15-be4d9ce0ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:51.016447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945576-e0fc-4bd3-bd15-be4d9ce0ff09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:51.017140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95945576-e0fc-4bd3-bd15-be4d9ce0ff09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:51.018708 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95945576-e0fc-4bd3-bd15-be4d9ce0ff09 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:51.029501 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1194/2383] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:51.033657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:51.043483 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f48b62-7f4a-4d5b-b0bc-59736321c16c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:51.048034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:51.048848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:51.049147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:51.049456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] PATH_INFO: `/v3/projects/237164960e16400bb0c3fbdf7d74cea8/users/a4100c3902a740728dc54bb19ada9bc1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:51.051254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=237164960e16400bb0c3fbdf7d74cea8, user_id=a4100c3902a740728dc54bb19ada9bc1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:51.053931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:51.064147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1190/2384] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:51 2022] PUT /identity/v3/projects/237164960e16400bb0c3fbdf7d74cea8/users/a4100c3902a740728dc54bb19ada9bc1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:51.074617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da551-928a-4641-93d4-82c4224a1048 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:51.074911 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da551-928a-4641-93d4-82c4224a1048 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:51.075194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870da551-928a-4641-93d4-82c4224a1048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:51.111627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-870da551-928a-4641-93d4-82c4224a1048 None None] MFA Rules not processed for user `a4100c3902a740728dc54bb19ada9bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:51.112803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-870da551-928a-4641-93d4-82c4224a1048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:51.185943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1195/2385] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:51 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:51.196782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:51.198510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:51.262809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6393b45-82b4-46b1-bb76-217599965fc4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:51.266328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:51.266835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:51.267126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:51.267409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:51.276699 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:51.278108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:51.286858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1191/2386] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:51 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:51.386924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870da551-928a-4641-93d4-82c4224a1048 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:51.396213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870da551-928a-4641-93d4-82c4224a1048 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:51.399563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcde08-8105-4831-a4bb-f6b9f23a2098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:51.400171 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcde08-8105-4831-a4bb-f6b9f23a2098 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:51.400465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcde08-8105-4831-a4bb-f6b9f23a2098 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:51.400745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcde08-8105-4831-a4bb-f6b9f23a2098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:51.464948 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcde08-8105-4831-a4bb-f6b9f23a2098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:51.466459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcde08-8105-4831-a4bb-f6b9f23a2098 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:51.475699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1196/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:51 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:51.826147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:51.893633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b83a6-9a61-485b-956f-5d53f95d788a service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:51.897955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:51.898783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:51.899078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:51.899368 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] PATH_INFO: `/v3/users/66619be998d64f8799c8918950076f56` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:51.900522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66619be998d64f8799c8918950076f56)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:51.902400 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:51.949053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66619be998d64f8799c8918950076f56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:51.949690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66619be998d64f8799c8918950076f56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:51.961520 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66619be998d64f8799c8918950076f56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:51.962152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66619be998d64f8799c8918950076f56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:51.969466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66619be998d64f8799c8918950076f56'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:51.981926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1192/2388] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:51 2022] DELETE /identity/v3/users/66619be998d64f8799c8918950076f56 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:52:51.986506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:51.986804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:51.987094 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:52.009269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:52.010432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:52.077293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1197/2389] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:52.088753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:52.090212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:52.155808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938fc69-c75c-43a5-a8ac-df105da5a4a7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:52.159236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:52.159806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:52.160131 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:52.160410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:52.172622 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:52.174093 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:52.184551 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1193/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:52:52.575892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:52.577408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:52.591135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93374258-7f1b-4d0f-95ed-9c40c64b5a72 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:52.596217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:52.597135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:52.597615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:52.598130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] PATH_INFO: `/v3/projects/5949ca1e77904462b90eed55004be0ad` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:52.599624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5949ca1e77904462b90eed55004be0ad)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:52.601587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:52.660568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5949ca1e77904462b90eed55004be0ad', 'request_id': 'req-1d768c2a-8192-462c-aa59-a7f368c42747'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.667750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5949ca1e77904462b90eed55004be0ad', 'request_id': 'req-1d768c2a-8192-462c-aa59-a7f368c42747'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.679273 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5949ca1e77904462b90eed55004be0ad', 'request_id': 'req-1d768c2a-8192-462c-aa59-a7f368c42747'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.690453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] The token cache is being invalidate because project 5949ca1e77904462b90eed55004be0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:52.690784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.691401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.692893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1198/2391] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:52 2022] DELETE /identity/v3/projects/5949ca1e77904462b90eed55004be0ad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:52.698385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:52.707827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58dee42-ba75-498c-8182-d85cfee56963 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:52.774199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:52.774995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:52.775285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:52.775568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] PATH_INFO: `/v3/users/a4100c3902a740728dc54bb19ada9bc1` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:52.776748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4100c3902a740728dc54bb19ada9bc1)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:52.778643 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:52.831291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4100c3902a740728dc54bb19ada9bc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.831904 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4100c3902a740728dc54bb19ada9bc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.845080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4100c3902a740728dc54bb19ada9bc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.845764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4100c3902a740728dc54bb19ada9bc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.854218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2d221599-a47e-4f01-86e5-765152ea8921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4100c3902a740728dc54bb19ada9bc1'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:52.876787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1194/2392] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:52:52 2022] DELETE /identity/v3/users/a4100c3902a740728dc54bb19ada9bc1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:53.218794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.220184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:53.233227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768c2a-8192-462c-aa59-a7f368c42747 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.296323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.297112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.297401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.297682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] PATH_INFO: `/v3/projects/237164960e16400bb0c3fbdf7d74cea8` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.298778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237164960e16400bb0c3fbdf7d74cea8)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.300800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:53.349123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237164960e16400bb0c3fbdf7d74cea8', 'request_id': 'req-d3909252-fdc7-4c1f-aeeb-c928f1125788'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.356776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237164960e16400bb0c3fbdf7d74cea8', 'request_id': 'req-d3909252-fdc7-4c1f-aeeb-c928f1125788'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.368692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237164960e16400bb0c3fbdf7d74cea8', 'request_id': 'req-d3909252-fdc7-4c1f-aeeb-c928f1125788'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.378208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] The token cache is being invalidate because project 237164960e16400bb0c3fbdf7d74cea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:52:53.378497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.379132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d3909252-fdc7-4c1f-aeeb-c928f1125788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:52:53.380588 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1199/2393] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:52:53 2022] DELETE /identity/v3/projects/237164960e16400bb0c3fbdf7d74cea8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:53.385533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4dcd0-a615-4c6b-b25b-474684436e75 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.386000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4dcd0-a615-4c6b-b25b-474684436e75 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.386096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4dcd0-a615-4c6b-b25b-474684436e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.408791 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-01a4dcd0-a615-4c6b-b25b-474684436e75 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:53.409963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-01a4dcd0-a615-4c6b-b25b-474684436e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:53.476194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1195/2394] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:53.483889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fac4-dd05-40d7-98e0-a7e1c7962290 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.484230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fac4-dd05-40d7-98e0-a7e1c7962290 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.484523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fac4-dd05-40d7-98e0-a7e1c7962290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.507349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f654fac4-dd05-40d7-98e0-a7e1c7962290 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:53.508536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f654fac4-dd05-40d7-98e0-a7e1c7962290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:53.515844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1200/2395] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:52:53.520150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4dcd0-a615-4c6b-b25b-474684436e75 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.529693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4dcd0-a615-4c6b-b25b-474684436e75 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.534087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.534693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.534999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.535355 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.536201 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:52:53.536685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.539134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:53.553615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1196/2396] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:52:53.558158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fac4-dd05-40d7-98e0-a7e1c7962290 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.566936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fac4-dd05-40d7-98e0-a7e1c7962290 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.571697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.572319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.572612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.572900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.573552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.575436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:53.603058 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1201/2397] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:52:53 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:52:53.606972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.617033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3b5ea-1c44-4015-bdbc-cee687182257 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.679770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.680564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.680859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.681143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.681783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.683671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:53.702236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1197/2398] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:52:53 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:52:53.706388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.718433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87617b-133f-4bb4-a8a9-9319f67a9b89 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.722694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.723276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.723562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.723842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.725281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.726975 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:53.736946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1202/2399] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:53.740965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.750552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a920b1-b41c-4438-9556-159d6bc44e05 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.754901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5a904-1e58-40b9-bc8d-52bc93403215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.755488 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5a904-1e58-40b9-bc8d-52bc93403215 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.755807 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5a904-1e58-40b9-bc8d-52bc93403215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.756544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5a904-1e58-40b9-bc8d-52bc93403215 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.756919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5a904-1e58-40b9-bc8d-52bc93403215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.758570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5a904-1e58-40b9-bc8d-52bc93403215 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:53.768497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1198/2400] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:52:53.772877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.782322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5c270-0b4c-4746-81b0-131db09a7960 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:53.786581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:53.787483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.787767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.788090 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] PATH_INFO: `/v3/projects/30fb516590454ef98f0dcb37452fee8a/users/f0638db534e9476eab7569511c8485b5/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.807448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fb516590454ef98f0dcb37452fee8a, user_id=f0638db534e9476eab7569511c8485b5, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:53.810135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:53.823285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1203/2401] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:52:53 2022] PUT /identity/v3/projects/30fb516590454ef98f0dcb37452fee8a/users/f0638db534e9476eab7569511c8485b5/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:52:53.834601 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cddb0d-f091-40c2-ae61-bf7c01e71617 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:53.834925 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cddb0d-f091-40c2-ae61-bf7c01e71617 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:53.835223 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cddb0d-f091-40c2-ae61-bf7c01e71617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:53.885537 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-91cddb0d-f091-40c2-ae61-bf7c01e71617 None None] MFA Rules not processed for user `f0638db534e9476eab7569511c8485b5`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:52:53.886706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-91cddb0d-f091-40c2-ae61-bf7c01e71617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:53.957818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1199/2402] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:52:53 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:52:53.967629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:52:53.969243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:52:54.032208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa86b6-f863-4c3d-8463-72ea2d79a3a8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:52:54.035642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b21b0-acfd-4339-a450-1ed9791920aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:52:54.036255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b21b0-acfd-4339-a450-1ed9791920aa service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:52:54.036544 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b21b0-acfd-4339-a450-1ed9791920aa service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:52:54.036827 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b21b0-acfd-4339-a450-1ed9791920aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:52:54.045912 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b21b0-acfd-4339-a450-1ed9791920aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:52:54.047341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b21b0-acfd-4339-a450-1ed9791920aa service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:52:54.057327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1204/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:52:53 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:17.039776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cddb0d-f091-40c2-ae61-bf7c01e71617 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:17.108317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cddb0d-f091-40c2-ae61-bf7c01e71617 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:17.112500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:17.113286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:17.113572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:17.113853 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] PATH_INFO: `/v3/users/f0638db534e9476eab7569511c8485b5` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:17.114959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0638db534e9476eab7569511c8485b5)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:17.117042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:17.164775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0638db534e9476eab7569511c8485b5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.169431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0638db534e9476eab7569511c8485b5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.181656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0638db534e9476eab7569511c8485b5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.182341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0638db534e9476eab7569511c8485b5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.189720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0638db534e9476eab7569511c8485b5'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.202570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1200/2404] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:53:17 2022] DELETE /identity/v3/users/f0638db534e9476eab7569511c8485b5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:17.207002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:17.207507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:17.207617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:17.230003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:17.231146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:17.296847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1205/2405] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:53:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:17.307888 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:17.309258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:17.373039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ce2e-99bc-4b55-8a66-ecdeffa9aade admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:17.376548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5b5f8-0d8d-4259-934e-f9661f867525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:17.377120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b5f8-0d8d-4259-934e-f9661f867525 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:17.377410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b5f8-0d8d-4259-934e-f9661f867525 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:17.377694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5b5f8-0d8d-4259-934e-f9661f867525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:17.387352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b5f8-0d8d-4259-934e-f9661f867525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:17.388809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5b5f8-0d8d-4259-934e-f9661f867525 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:17.397991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1201/2406] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:17.762694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:17.765277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:17.778372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4090a-9167-4a64-8b0c-8d3426b5fc0f None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:17.784249 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:17.785125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:17.785453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:17.785776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] PATH_INFO: `/v3/projects/30fb516590454ef98f0dcb37452fee8a` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:17.787342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fb516590454ef98f0dcb37452fee8a)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:17.789451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:17.838960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fb516590454ef98f0dcb37452fee8a', 'request_id': 'req-e99e3222-12b6-4cce-9912-0a5dbcfe22df'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.845604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fb516590454ef98f0dcb37452fee8a', 'request_id': 'req-e99e3222-12b6-4cce-9912-0a5dbcfe22df'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.856692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fb516590454ef98f0dcb37452fee8a', 'request_id': 'req-e99e3222-12b6-4cce-9912-0a5dbcfe22df'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.866728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] The token cache is being invalidate because project 30fb516590454ef98f0dcb37452fee8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:53:17.867024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.867631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-e99e3222-12b6-4cce-9912-0a5dbcfe22df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:17.869055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1206/2407] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:53:17 2022] DELETE /identity/v3/projects/30fb516590454ef98f0dcb37452fee8a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:17.873826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570238a5-c732-46bf-bc90-3ab69fa0f4b7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:17.874164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570238a5-c732-46bf-bc90-3ab69fa0f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:17.874464 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570238a5-c732-46bf-bc90-3ab69fa0f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:17.897636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-570238a5-c732-46bf-bc90-3ab69fa0f4b7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:17.898860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-570238a5-c732-46bf-bc90-3ab69fa0f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:17.962810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1202/2408] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:53:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:17.970414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e276b-c024-42cf-8166-7cff300b4151 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:17.970718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e276b-c024-42cf-8166-7cff300b4151 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:17.971013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e276b-c024-42cf-8166-7cff300b4151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:17.995136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-046e276b-c024-42cf-8166-7cff300b4151 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:17.996325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-046e276b-c024-42cf-8166-7cff300b4151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:18.003510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1207/2409] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:53:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:18.008403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570238a5-c732-46bf-bc90-3ab69fa0f4b7 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:18.017528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570238a5-c732-46bf-bc90-3ab69fa0f4b7 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:18.021811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:18.022397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.022690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.022978 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.023672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:53:18.024015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:18.025591 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:18.037782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1203/2410] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:53:18.042038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e276b-c024-42cf-8166-7cff300b4151 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:18.050672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e276b-c024-42cf-8166-7cff300b4151 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:18.055555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:18.056427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.056717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.057000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.057628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:18.059781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:18.087319 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1208/2411] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:53:18 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:53:18.091449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:18.101103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf21fc-71ee-4031-9946-f14eb7a615cc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:18.163697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:18.164319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.164612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.164902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.165532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:18.167414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:18.187175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1204/2412] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:53:18 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:53:18.191277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:18.202346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5ef5d-bcde-4087-addf-64f8e7fee6b2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:18.206676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:18.207259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.207790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.207790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.208534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:18.210557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:18.220382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1209/2413] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:53:18.224198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:18.233724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffd037-e195-4dd0-a5b8-5415ac63c523 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:18.238428 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4fab9-27f9-403b-a1c5-ca909c947a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:18.239010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4fab9-27f9-403b-a1c5-ca909c947a59 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.239300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4fab9-27f9-403b-a1c5-ca909c947a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.239585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4fab9-27f9-403b-a1c5-ca909c947a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.240315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4fab9-27f9-403b-a1c5-ca909c947a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:18.243024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4fab9-27f9-403b-a1c5-ca909c947a59 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:18.252804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1205/2414] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:53:18.257256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:18.267009 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b27be-243c-47f7-8a3d-77c24926584e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:18.271310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:18.272321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.272620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.272907 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] PATH_INFO: `/v3/projects/c615d2563194449eb1251ad2a4dc214e/users/35af8eeff218410c9cc5834c2ec79e74/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.292002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c615d2563194449eb1251ad2a4dc214e, user_id=35af8eeff218410c9cc5834c2ec79e74, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:18.294781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:18.307983 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1210/2415] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:53:18 2022] PUT /identity/v3/projects/c615d2563194449eb1251ad2a4dc214e/users/35af8eeff218410c9cc5834c2ec79e74/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:18.369866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128e77-d627-4406-bbde-8043e9929d5a None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.370076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128e77-d627-4406-bbde-8043e9929d5a None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.370357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128e77-d627-4406-bbde-8043e9929d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.405756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5b128e77-d627-4406-bbde-8043e9929d5a None None] MFA Rules not processed for user `35af8eeff218410c9cc5834c2ec79e74`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:18.406963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5b128e77-d627-4406-bbde-8043e9929d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:18.481514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1206/2416] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:53:18 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:18.492550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:18.494223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:18.559284 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b413ea8-3bf2-466e-8eb3-258712e2e874 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:18.562766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef636b-d3d9-46da-8204-b4d148102e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:18.563346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef636b-d3d9-46da-8204-b4d148102e11 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:18.563638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef636b-d3d9-46da-8204-b4d148102e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:18.563937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef636b-d3d9-46da-8204-b4d148102e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:18.572348 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef636b-d3d9-46da-8204-b4d148102e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:18.573778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef636b-d3d9-46da-8204-b4d148102e11 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:18.582177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1211/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:18 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:21.499610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128e77-d627-4406-bbde-8043e9929d5a None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:21.567745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128e77-d627-4406-bbde-8043e9929d5a None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:21.572819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:21.573614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:21.573907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:21.574192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] PATH_INFO: `/v3/users/35af8eeff218410c9cc5834c2ec79e74` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:21.575295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=35af8eeff218410c9cc5834c2ec79e74)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:21.577228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:21.624120 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35af8eeff218410c9cc5834c2ec79e74'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:21.624767 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35af8eeff218410c9cc5834c2ec79e74'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:21.637003 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35af8eeff218410c9cc5834c2ec79e74'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:21.637645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35af8eeff218410c9cc5834c2ec79e74'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:21.645053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35af8eeff218410c9cc5834c2ec79e74'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:21.658021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1207/2418] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:53:21 2022] DELETE /identity/v3/users/35af8eeff218410c9cc5834c2ec79e74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:21.662541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:21.663236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:21.663236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:21.684908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:21.686110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:21.750383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1212/2419] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:53:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:21.761409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:21.762730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:21.827224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83638a6-2faa-4d2f-81c8-2d2d1bb029ab admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:21.830971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad41294-3d24-4044-9e10-87f60242cdcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:21.831557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41294-3d24-4044-9e10-87f60242cdcf service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:21.831858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41294-3d24-4044-9e10-87f60242cdcf service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:21.832292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad41294-3d24-4044-9e10-87f60242cdcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:21.841508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad41294-3d24-4044-9e10-87f60242cdcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:21.842927 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad41294-3d24-4044-9e10-87f60242cdcf service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:21.852436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1208/2420] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:22.282217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:22.283864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:22.296148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edcb46-7c97-4fda-a31f-f73678c6f0e0 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:22.300934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:22.301859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:22.302191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:22.302291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] PATH_INFO: `/v3/projects/c615d2563194449eb1251ad2a4dc214e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:22.304693 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c615d2563194449eb1251ad2a4dc214e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:22.306780 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:22.358077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c615d2563194449eb1251ad2a4dc214e', 'request_id': 'req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:22.364915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c615d2563194449eb1251ad2a4dc214e', 'request_id': 'req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:22.376276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c615d2563194449eb1251ad2a4dc214e', 'request_id': 'req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:22.386949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] The token cache is being invalidate because project c615d2563194449eb1251ad2a4dc214e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:53:22.387234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:22.387862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:53:22.389315 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1213/2421] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:53:22 2022] DELETE /identity/v3/projects/c615d2563194449eb1251ad2a4dc214e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:53:26.605318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c473b-96d2-43ca-b589-0a59ca268abc None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:26.605812 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c473b-96d2-43ca-b589-0a59ca268abc None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:26.605911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c473b-96d2-43ca-b589-0a59ca268abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:26.628530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-bb0c473b-96d2-43ca-b589-0a59ca268abc None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:26.629679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bb0c473b-96d2-43ca-b589-0a59ca268abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:26.694507 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1209/2422] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:53:26 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:26.743023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:26.744512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:26.818127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa0a7-aaf7-4fe8-9c66-d497d64161f2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:26.823169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cba84-533c-4693-94d8-68e58cbd09a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:26.823751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cba84-533c-4693-94d8-68e58cbd09a0 service swift] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:26.824078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cba84-533c-4693-94d8-68e58cbd09a0 service swift] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:26.824366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cba84-533c-4693-94d8-68e58cbd09a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:26.832229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cba84-533c-4693-94d8-68e58cbd09a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:26.833811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cba84-533c-4693-94d8-68e58cbd09a0 service swift] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:26.841612 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1214/2423] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:53:45.608037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f179-9c5e-4662-bf55-41a283863c69 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:45.608559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f179-9c5e-4662-bf55-41a283863c69 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:45.608837 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295f179-9c5e-4662-bf55-41a283863c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:45.663814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c295f179-9c5e-4662-bf55-41a283863c69 None None] MFA Rules not processed for user `44a64fb1ebd9411eb6156c8ef97c3072`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:45.665026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c295f179-9c5e-4662-bf55-41a283863c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:45.718558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:45.719118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:45.719222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:45.728779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1210/2424] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:53:45 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:53:45.744445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:53:45.745679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:45.752744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1215/2425] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:53:45 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:53:45.765135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f179-9c5e-4662-bf55-41a283863c69 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:45.776736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295f179-9c5e-4662-bf55-41a283863c69 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:45.781720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:45.782310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:45.782604 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:45.782966 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:45.792557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:45.794118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:45.802205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1211/2426] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:53:49.087265 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:49.093030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:49.196567 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047157ad-f1f7-46c7-93f0-7ce8370290be None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:49.200706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:49.201568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:49.202015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:49.202465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:49.204194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:49.286114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:49.288614 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:49.299365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1216/2427] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:49 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:53:50.459533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:53:50.461054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:50.481134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb793e-c144-4e0e-b9c5-f2aa2eee00e8 service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:53:50.492121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:53:50.492893 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:53:50.493191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:53:50.493651 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:53:50.495636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:53:50.509968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:53:50.511513 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:53:50.527467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1212/2428] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:53:50 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:00.727603 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:00.738321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b79467-d3fe-467a-ac2a-a8e7d8bbcc7a service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:00.743679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:00.744514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:00.744974 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:00.745257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:00.747841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:00.763710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:00.765415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:00.776583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1217/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:00 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:06.859843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:06.861265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:06.923614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d099-e427-4aec-a765-752468dcada8 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:06.927052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2bb6-fa49-437f-a059-20fb0ff0d2e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:06.927634 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2bb6-fa49-437f-a059-20fb0ff0d2e6 service glance] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:06.928014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2bb6-fa49-437f-a059-20fb0ff0d2e6 service glance] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:06.928237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2bb6-fa49-437f-a059-20fb0ff0d2e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:06.930040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e31d2bb6-fa49-437f-a059-20fb0ff0d2e6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:06.997192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:06.998602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:07.014524 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d7cde-afd6-4d8b-997d-71f5a6c2190c service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:07.019453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:07.020061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:07.020351 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:07.020632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:07.021675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2bb6-fa49-437f-a059-20fb0ff0d2e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:07.023122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2bb6-fa49-437f-a059-20fb0ff0d2e6 service glance] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:07.029638 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:07.031228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:07.043633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1213/2430] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:06 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:07.052556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1218/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:06 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:54:07.082286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c38586-9038-47c0-98ca-244c5576508f None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:07.082654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c38586-9038-47c0-98ca-244c5576508f None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:07.083014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c38586-9038-47c0-98ca-244c5576508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:07.106011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f4c38586-9038-47c0-98ca-244c5576508f None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:07.107169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f4c38586-9038-47c0-98ca-244c5576508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:07.113951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1214/2432] 10.222.0.23 () {58 vars in 967 bytes} [Fri Apr 8 02:54:07 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:07.126124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:07.137603 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a2624-08c5-45f3-b129-73ab67ec5443 service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:07.142462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:07.143042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:07.143337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:07.143641 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:07.152512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:07.154107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:07.161790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1219/2433] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:54:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:54:19.571423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c38586-9038-47c0-98ca-244c5576508f None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:19.580955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c38586-9038-47c0-98ca-244c5576508f None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:19.584453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:19.585035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:19.585528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:19.585833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:19.598198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:19.608612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:19.610245 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:19.628747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1215/2434] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:19 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:19.741191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:19.743358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:19.826227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6537bc4-8437-4bb9-9294-fee415d590ba service swift] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:19.830934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:19.831520 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:19.831813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:19.832133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:19.833822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:19.845118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:19.846718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:19.855954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1220/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:19 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:19.948945 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:19.950260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:19.965468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a84c-d52f-47a3-b7ac-1932844a7b42 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:19.970129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:19.970698 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:19.970988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:19.971271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:19.972930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:19.984817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:19.986505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:19.996976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1216/2436] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:19 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:31.194232 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:31.203571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92720a-46b4-4c3f-a4f8-3ec98ff1efbf service placement] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:31.207001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:31.207566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:31.207855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:31.208175 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:31.209826 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:31.278893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:31.280352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:31.289414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1221/2437] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:36.284744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:36.286165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:36.299236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c276e8-7a34-44f5-9df3-faa504153a23 service placement] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:36.303514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:36.304334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:36.304628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:36.304911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] PATH_INFO: `/v3/users/008fc39c532a4a0ca8fc83e0d244a370` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:36.325095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008fc39c532a4a0ca8fc83e0d244a370)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:36.327048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:36.374215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008fc39c532a4a0ca8fc83e0d244a370'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.374859 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008fc39c532a4a0ca8fc83e0d244a370'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.387839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008fc39c532a4a0ca8fc83e0d244a370'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.388506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008fc39c532a4a0ca8fc83e0d244a370'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.395968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-116ef585-375a-4888-881d-b97e76abdd66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008fc39c532a4a0ca8fc83e0d244a370'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.408510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1217/2438] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:54:36 2022] DELETE /identity/v3/users/008fc39c532a4a0ca8fc83e0d244a370 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:36.625180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:36.634977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fc884-db58-4492-b2cc-26d00a8f4ff1 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:36.697514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:36.698350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:36.698645 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:36.698935 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] PATH_INFO: `/v3/projects/16870ad51e0f4d1d9d73d3922e34a632` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:36.710682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16870ad51e0f4d1d9d73d3922e34a632)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:36.713155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:36.764462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16870ad51e0f4d1d9d73d3922e34a632', 'request_id': 'req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.777322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16870ad51e0f4d1d9d73d3922e34a632', 'request_id': 'req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.789356 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16870ad51e0f4d1d9d73d3922e34a632', 'request_id': 'req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.802748 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] The token cache is being invalidate because project 16870ad51e0f4d1d9d73d3922e34a632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:54:36.803038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.803883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8a5f4a01-479a-49ee-8a21-b2ceb0b89453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:36.805454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1222/2439] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:54:36 2022] DELETE /identity/v3/projects/16870ad51e0f4d1d9d73d3922e34a632 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:36.819214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5655e3-347a-472a-82a2-65ee975d9a84 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:36.819512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5655e3-347a-472a-82a2-65ee975d9a84 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:36.819796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5655e3-347a-472a-82a2-65ee975d9a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:36.846140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-ea5655e3-347a-472a-82a2-65ee975d9a84 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:36.847312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ea5655e3-347a-472a-82a2-65ee975d9a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:36.924457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1218/2440] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:36.928552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4b22-7f06-47e5-a10c-33f4549cb8a0 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:36.929122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4b22-7f06-47e5-a10c-33f4549cb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:36.929569 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e4b22-7f06-47e5-a10c-33f4549cb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:36.953618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2a8e4b22-7f06-47e5-a10c-33f4549cb8a0 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:36.954719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2a8e4b22-7f06-47e5-a10c-33f4549cb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:36.965197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1223/2441] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:36.969412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5655e3-347a-472a-82a2-65ee975d9a84 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:36.980263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5655e3-347a-472a-82a2-65ee975d9a84 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:36.985036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:36.985625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:36.985917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:36.986203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:36.986967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:54:36.987273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:36.988896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.002661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1219/2442] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:54:37.006887 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e4b22-7f06-47e5-a10c-33f4549cb8a0 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.016867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e4b22-7f06-47e5-a10c-33f4549cb8a0 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.021363 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.022088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.022491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.022904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.023631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.026351 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.052982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1224/2443] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:54:37 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:54:37.057323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.066754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e0066-c2c0-49b0-a3d0-3507e639d3ae admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.132350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.132968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.133265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.134105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.134975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.139605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.162266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1220/2444] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:54:37 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:54:37.166712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.176881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582326a6-a178-4e9f-9acf-3422a244fb0f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.181355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.182208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.182503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.182794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.183684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.185314 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.195776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1225/2445] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:54:37.200598 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.211756 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a3c6-07fb-4cf4-b675-ca0328695f95 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.219050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074d80-2008-4310-88db-986373ebcd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.219706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074d80-2008-4310-88db-986373ebcd76 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.220033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074d80-2008-4310-88db-986373ebcd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.220322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074d80-2008-4310-88db-986373ebcd76 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.221026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074d80-2008-4310-88db-986373ebcd76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.222801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d074d80-2008-4310-88db-986373ebcd76 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.234451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1221/2446] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:54:37.238601 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.249293 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda66d2-a9ef-4c49-9c07-5a014124714c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.253982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.254798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.255088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.255373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] PATH_INFO: `/v3/projects/6ad12e9338ed4a37a87f91f1adc3bd25/users/177059e8f93642649b51d7dc0a887f3b/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.274994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad12e9338ed4a37a87f91f1adc3bd25, user_id=177059e8f93642649b51d7dc0a887f3b, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.277657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.291100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1226/2447] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:54:37 2022] PUT /identity/v3/projects/6ad12e9338ed4a37a87f91f1adc3bd25/users/177059e8f93642649b51d7dc0a887f3b/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:37.301298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0aada-74b4-4c8d-a89e-b7ab0e0b9e4b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.301811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0aada-74b4-4c8d-a89e-b7ab0e0b9e4b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.301910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0aada-74b4-4c8d-a89e-b7ab0e0b9e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.339468 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b6b0aada-74b4-4c8d-a89e-b7ab0e0b9e4b None None] MFA Rules not processed for user `177059e8f93642649b51d7dc0a887f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:37.340680 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b6b0aada-74b4-4c8d-a89e-b7ab0e0b9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:37.414332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1222/2448] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:37 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:37.419393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.488669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446485b9-c960-438a-908b-5cdb43a0a141 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.493956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.494554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.494847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.495133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.495798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.497731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.525110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1227/2449] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:54:37 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:54:37.529001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0aada-74b4-4c8d-a89e-b7ab0e0b9e4b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.539279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0aada-74b4-4c8d-a89e-b7ab0e0b9e4b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.605057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.605845 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.606151 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.606447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.607103 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.609224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.635530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1223/2450] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:54:37 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:54:37.636790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.647391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d9ec9-7186-4db1-acf2-97cba698e7eb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.652553 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.653170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.653469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.653758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.654474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.656123 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.668342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1228/2451] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:54:37.672752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.683015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a335e2-740b-406b-9eb2-ca956f5bb07f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.687899 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.688780 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.689077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.689366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] PATH_INFO: `/v3/projects/f332c2c6d5ab4cd9af762704ee721d76/users/727f1e90f68143a8a363125b4b522bcb/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.709584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f332c2c6d5ab4cd9af762704ee721d76, user_id=727f1e90f68143a8a363125b4b522bcb, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.712969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.726841 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1224/2452] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:54:37 2022] PUT /identity/v3/projects/f332c2c6d5ab4cd9af762704ee721d76/users/727f1e90f68143a8a363125b4b522bcb/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:37.731341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.740838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bfed6-4c40-436d-9bee-30d4fc732f62 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.809532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32167b-4c05-4362-be1d-dc789ce116f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.810137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32167b-4c05-4362-be1d-dc789ce116f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.810435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32167b-4c05-4362-be1d-dc789ce116f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.810720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32167b-4c05-4362-be1d-dc789ce116f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.811424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32167b-4c05-4362-be1d-dc789ce116f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.813046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32167b-4c05-4362-be1d-dc789ce116f3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.823373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1229/2453] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:54:37.827625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.838565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9168681-7cd7-4446-a234-50fa73f8a601 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:37.842866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:37.843700 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.844034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.844322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] PATH_INFO: `/v3/projects/f332c2c6d5ab4cd9af762704ee721d76/users/727f1e90f68143a8a363125b4b522bcb/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.846081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f332c2c6d5ab4cd9af762704ee721d76, user_id=727f1e90f68143a8a363125b4b522bcb, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:37.848708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:37.858672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1225/2454] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:54:37 2022] PUT /identity/v3/projects/f332c2c6d5ab4cd9af762704ee721d76/users/727f1e90f68143a8a363125b4b522bcb/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:54:37.869835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b72da-5c8a-4b1b-aebd-baec2e899736 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:37.870140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b72da-5c8a-4b1b-aebd-baec2e899736 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:37.870433 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b72da-5c8a-4b1b-aebd-baec2e899736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:37.908957 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-cf9b72da-5c8a-4b1b-aebd-baec2e899736 None None] MFA Rules not processed for user `727f1e90f68143a8a363125b4b522bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:37.910039 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cf9b72da-5c8a-4b1b-aebd-baec2e899736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:37.985207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1230/2455] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:37 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:37.995128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:37.996813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:38.061300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238157d-430c-495f-aab1-2b62cef4722b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:38.064724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:38.065291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:38.065580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:38.065862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:38.075434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:38.076868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:38.085645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1226/2456] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:37 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:38.183805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b72da-5c8a-4b1b-aebd-baec2e899736 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:38.193725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b72da-5c8a-4b1b-aebd-baec2e899736 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:38.197256 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bfe39-2e04-4fd1-a918-a592f26d7afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:38.197830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bfe39-2e04-4fd1-a918-a592f26d7afe service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:38.198121 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bfe39-2e04-4fd1-a918-a592f26d7afe service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:38.198407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bfe39-2e04-4fd1-a918-a592f26d7afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:38.261976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bfe39-2e04-4fd1-a918-a592f26d7afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:38.263470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bfe39-2e04-4fd1-a918-a592f26d7afe service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:38.272208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1231/2457] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:38 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:50.345781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:50.418728 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8461c-2b58-48a6-aac3-13fe9ff97106 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:50.423110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:50.423917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:50.424241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:50.424532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] PATH_INFO: `/v3/users/177059e8f93642649b51d7dc0a887f3b` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:50.425641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] RBAC: Authorizing `identity:delete_user(user_id=177059e8f93642649b51d7dc0a887f3b)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:50.427564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:50.476346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177059e8f93642649b51d7dc0a887f3b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:50.477657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177059e8f93642649b51d7dc0a887f3b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:50.489048 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177059e8f93642649b51d7dc0a887f3b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:50.489685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177059e8f93642649b51d7dc0a887f3b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:50.497305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177059e8f93642649b51d7dc0a887f3b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:50.511781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1227/2458] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:54:50 2022] DELETE /identity/v3/users/177059e8f93642649b51d7dc0a887f3b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:50.516562 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:50.516998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:50.517208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:50.538701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:50.540519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:50.605204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1232/2459] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:54:50.615273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:50.616659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:50.680965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba6582-622f-4110-9008-186bbe8719da admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:50.684740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:50.685317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:50.685611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:50.685900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:50.694631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:50.696736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:50.705629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1228/2460] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:54:51.043539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:51.044946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:51.057124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454595c-03bc-478a-b3cc-cd3e7901115c None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:51.061744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:51.062573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:51.062864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:51.063148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] PATH_INFO: `/v3/projects/6ad12e9338ed4a37a87f91f1adc3bd25` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:51.064279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad12e9338ed4a37a87f91f1adc3bd25)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:51.066166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:51.114136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad12e9338ed4a37a87f91f1adc3bd25', 'request_id': 'req-fd5f991f-f989-4805-953a-53939aad551a'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.121326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad12e9338ed4a37a87f91f1adc3bd25', 'request_id': 'req-fd5f991f-f989-4805-953a-53939aad551a'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.132044 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad12e9338ed4a37a87f91f1adc3bd25', 'request_id': 'req-fd5f991f-f989-4805-953a-53939aad551a'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.143590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] The token cache is being invalidate because project 6ad12e9338ed4a37a87f91f1adc3bd25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:54:51.143815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.144485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.145920 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1233/2461] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:54:51 2022] DELETE /identity/v3/projects/6ad12e9338ed4a37a87f91f1adc3bd25 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:54:51.149914 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:51.159310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b08ec2-8dc4-42fe-8b70-3ab388d7b66b service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:51.225847 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:51.226632 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:51.227895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:51.228217 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] PATH_INFO: `/v3/users/727f1e90f68143a8a363125b4b522bcb` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:51.229300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=727f1e90f68143a8a363125b4b522bcb)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:51.231203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:51.278895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727f1e90f68143a8a363125b4b522bcb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.279540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727f1e90f68143a8a363125b4b522bcb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.291180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727f1e90f68143a8a363125b4b522bcb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.291836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727f1e90f68143a8a363125b4b522bcb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.299418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-3973d6f1-2576-4bf9-a76d-9ee8e0ec83fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727f1e90f68143a8a363125b4b522bcb'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.311466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1229/2462] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:54:51 2022] DELETE /identity/v3/users/727f1e90f68143a8a363125b4b522bcb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:51.666032 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:51.667480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:51.680928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f991f-f989-4805-953a-53939aad551a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:51.744307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:51.745035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:51.745329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:51.745617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] PATH_INFO: `/v3/projects/f332c2c6d5ab4cd9af762704ee721d76` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:51.746727 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f332c2c6d5ab4cd9af762704ee721d76)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:51.748667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:51.795583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f332c2c6d5ab4cd9af762704ee721d76', 'request_id': 'req-4bcdc17e-8235-4592-8485-9953c5f27bdb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.802223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f332c2c6d5ab4cd9af762704ee721d76', 'request_id': 'req-4bcdc17e-8235-4592-8485-9953c5f27bdb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.815807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f332c2c6d5ab4cd9af762704ee721d76', 'request_id': 'req-4bcdc17e-8235-4592-8485-9953c5f27bdb'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.826483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] The token cache is being invalidate because project f332c2c6d5ab4cd9af762704ee721d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:54:51.826770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.827407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4bcdc17e-8235-4592-8485-9953c5f27bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:54:51.828865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1234/2463] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:54:51 2022] DELETE /identity/v3/projects/f332c2c6d5ab4cd9af762704ee721d76 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:51.833623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe9ce5-12cc-495a-b2e2-fb46b05bfab1 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:51.834090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe9ce5-12cc-495a-b2e2-fb46b05bfab1 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:51.834250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe9ce5-12cc-495a-b2e2-fb46b05bfab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:51.857100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-82fe9ce5-12cc-495a-b2e2-fb46b05bfab1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:51.858256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-82fe9ce5-12cc-495a-b2e2-fb46b05bfab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:51.922424 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1230/2464] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:51.930637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a786ff-3f53-4853-bf95-68049ac4e6ef None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:51.930929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a786ff-3f53-4853-bf95-68049ac4e6ef None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:51.931242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a786ff-3f53-4853-bf95-68049ac4e6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:51.953790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-63a786ff-3f53-4853-bf95-68049ac4e6ef None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:51.954947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-63a786ff-3f53-4853-bf95-68049ac4e6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:51.962227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1235/2465] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:54:51.966312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe9ce5-12cc-495a-b2e2-fb46b05bfab1 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:51.975419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe9ce5-12cc-495a-b2e2-fb46b05bfab1 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:51.980260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:51.980869 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:51.981164 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:51.981451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:51.982152 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:54:51.982459 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:51.984090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:51.997218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1231/2466] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:54:52.001048 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a786ff-3f53-4853-bf95-68049ac4e6ef None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.010369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a786ff-3f53-4853-bf95-68049ac4e6ef None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.014688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.015264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.015554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.015839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.016502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.018379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.044384 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1236/2467] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:54:52 2022] POST /identity/v3/projects => generated 409 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:54:52.048341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.058579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13af832-2f75-4a0c-8364-18936e0c0749 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.119870 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.120499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.120798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.121088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.121734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.123639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.142706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1232/2468] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:54:52 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:54:52.146921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.157297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3690eb1-f5fd-41b4-b307-288c87f048c8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.161540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.162129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.162413 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.162696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.163392 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.170085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.181928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1237/2469] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:54:52.185934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.199806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51d85-f8da-4183-8c8e-bdf051c1c539 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.206624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19601b98-7dd2-4aef-b898-ec7826a5cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.207227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601b98-7dd2-4aef-b898-ec7826a5cee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.207519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601b98-7dd2-4aef-b898-ec7826a5cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.207806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19601b98-7dd2-4aef-b898-ec7826a5cee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.208545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19601b98-7dd2-4aef-b898-ec7826a5cee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.210708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19601b98-7dd2-4aef-b898-ec7826a5cee3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.223250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1233/2470] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:54:52.229383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.240328 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71279adb-a64c-4fea-bdc0-976270d94f88 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.245597 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.246412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.246707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.246996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] PATH_INFO: `/v3/projects/6f573c9baf2440439963355048513e4f/users/68536641975240eda68e19e19221e06f/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.266242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f573c9baf2440439963355048513e4f, user_id=68536641975240eda68e19e19221e06f, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.268854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.281285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1238/2471] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:54:52 2022] PUT /identity/v3/projects/6f573c9baf2440439963355048513e4f/users/68536641975240eda68e19e19221e06f/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:52.293431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ada3d1-d7eb-496d-a38a-accac8e0a238 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.293758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ada3d1-d7eb-496d-a38a-accac8e0a238 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.294044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ada3d1-d7eb-496d-a38a-accac8e0a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.333779 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-94ada3d1-d7eb-496d-a38a-accac8e0a238 None None] MFA Rules not processed for user `68536641975240eda68e19e19221e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:52.335592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-94ada3d1-d7eb-496d-a38a-accac8e0a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:52.423935 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1234/2472] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:52 2022] POST /identity/v3/auth/tokens => generated 3716 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:52.428444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.515088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941498f-3d27-4663-81fa-88db539c1af5 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.521868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.522396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.522689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.522977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.524207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.526979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.556077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1239/2473] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:54:52 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:54:52.560446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ada3d1-d7eb-496d-a38a-accac8e0a238 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.571188 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ada3d1-d7eb-496d-a38a-accac8e0a238 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.642377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.643168 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.643465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.643951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.644948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.648165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.672146 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1235/2474] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:54:52 2022] POST /identity/v3/users => generated 310 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:54:52.676105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.687324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a16e25-829e-42b9-88b5-f648878be472 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.691801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.692427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.692720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.693007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.693711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.695336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.706906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1240/2475] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:54:52.715252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.725154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff08fc4-0dee-456c-9c3e-76af33bce00c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.730532 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.731330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.731620 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.731911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] PATH_INFO: `/v3/projects/dae65b9ef4674dac95775531d713e7d3/users/5dc5d787c33f4207b3795bbfce20a2e6/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.752467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae65b9ef4674dac95775531d713e7d3, user_id=5dc5d787c33f4207b3795bbfce20a2e6, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.755128 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.772315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1236/2476] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:54:52 2022] PUT /identity/v3/projects/dae65b9ef4674dac95775531d713e7d3/users/5dc5d787c33f4207b3795bbfce20a2e6/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:54:52.777330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.789187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77370698-a65e-4a19-b71d-e936f5724f20 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.855816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6930b1-b5e1-4a30-a4a3-9933fcb3d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.856447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6930b1-b5e1-4a30-a4a3-9933fcb3d762 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.856737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6930b1-b5e1-4a30-a4a3-9933fcb3d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.857021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6930b1-b5e1-4a30-a4a3-9933fcb3d762 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.857720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6930b1-b5e1-4a30-a4a3-9933fcb3d762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.859307 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6930b1-b5e1-4a30-a4a3-9933fcb3d762 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.870648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1241/2477] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:54:52.875005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:52.886037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c4c7e-6b15-4f23-9d8e-605754265e1d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:52.891770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:52.892619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.892912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.893194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] PATH_INFO: `/v3/projects/dae65b9ef4674dac95775531d713e7d3/users/5dc5d787c33f4207b3795bbfce20a2e6/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.895053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae65b9ef4674dac95775531d713e7d3, user_id=5dc5d787c33f4207b3795bbfce20a2e6, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:52.897800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:52.909505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1237/2478] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:54:52 2022] PUT /identity/v3/projects/dae65b9ef4674dac95775531d713e7d3/users/5dc5d787c33f4207b3795bbfce20a2e6/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:54:52.919669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be23c-0d17-481d-bd85-875f2341e7b8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:52.919984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be23c-0d17-481d-bd85-875f2341e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:52.920272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be23c-0d17-481d-bd85-875f2341e7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:52.964665 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bf4be23c-0d17-481d-bd85-875f2341e7b8 None None] MFA Rules not processed for user `5dc5d787c33f4207b3795bbfce20a2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:54:52.965840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bf4be23c-0d17-481d-bd85-875f2341e7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:53.059457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1242/2479] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:54:52 2022] POST /identity/v3/auth/tokens => generated 3781 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:54:53.068975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:53.071127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:54:53.136641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afedf2c-2494-4793-846f-096673d0bd22 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:53.140176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:53.140754 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:53.141045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:53.141331 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:53.150070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:53.151480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:53.160322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1238/2480] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:53 2022] GET /identity/v3/auth/tokens => generated 3781 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:54:53.323113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4be23c-0d17-481d-bd85-875f2341e7b8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:54:53.332526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4be23c-0d17-481d-bd85-875f2341e7b8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:54:53.335938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93cc65-1caa-4436-bfc2-d1edabd3ca98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:54:53.337033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93cc65-1caa-4436-bfc2-d1edabd3ca98 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:54:53.337324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93cc65-1caa-4436-bfc2-d1edabd3ca98 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:54:53.337605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93cc65-1caa-4436-bfc2-d1edabd3ca98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:54:53.400776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93cc65-1caa-4436-bfc2-d1edabd3ca98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:54:53.402213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93cc65-1caa-4436-bfc2-d1edabd3ca98 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:54:53.410928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1243/2481] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:54:53 2022] GET /identity/v3/auth/tokens => generated 3716 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:02.222562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:02.291650 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ddb9e-ec18-42f1-bf66-e731b758931c service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:02.295883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:02.296724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:02.297021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:02.297311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] PATH_INFO: `/v3/users/68536641975240eda68e19e19221e06f` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:02.298440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68536641975240eda68e19e19221e06f)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:02.300386 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:02.348014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68536641975240eda68e19e19221e06f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:02.348656 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68536641975240eda68e19e19221e06f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:02.359975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68536641975240eda68e19e19221e06f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:02.360603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68536641975240eda68e19e19221e06f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:02.368564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68536641975240eda68e19e19221e06f'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:02.381297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1239/2482] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:02 2022] DELETE /identity/v3/users/68536641975240eda68e19e19221e06f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:02.386366 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:02.386889 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:02.386995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:02.408487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:02.409630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:02.474064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1244/2483] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:02.484666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:02.486111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:02.550615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00df87-218e-483e-9d67-004bd76039d1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:02.554047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:02.554716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:02.556037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:02.556325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:02.565345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:02.566811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:02.576002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1240/2484] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:02.940542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:02.941903 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:02.953772 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df0fd-13bc-4d63-9865-7407032fb656 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:02.958487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:02.959272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:02.959568 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:02.959847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] PATH_INFO: `/v3/projects/6f573c9baf2440439963355048513e4f` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:02.961461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f573c9baf2440439963355048513e4f)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:02.963393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:03.011632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f573c9baf2440439963355048513e4f', 'request_id': 'req-830688ab-a467-4d90-98a0-27e958d11879'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.017483 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f573c9baf2440439963355048513e4f', 'request_id': 'req-830688ab-a467-4d90-98a0-27e958d11879'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.028674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f573c9baf2440439963355048513e4f', 'request_id': 'req-830688ab-a467-4d90-98a0-27e958d11879'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.038091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] The token cache is being invalidate because project 6f573c9baf2440439963355048513e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:03.038374 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.039038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.040977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1245/2485] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:02 2022] DELETE /identity/v3/projects/6f573c9baf2440439963355048513e4f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:03.044926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:03.054244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5e8ea-5966-40d7-b45c-b0f35e996c5f service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:03.119005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:03.119801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:03.120157 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:03.120480 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] PATH_INFO: `/v3/users/5dc5d787c33f4207b3795bbfce20a2e6` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:03.121584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc5d787c33f4207b3795bbfce20a2e6)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:03.123476 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:03.170165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc5d787c33f4207b3795bbfce20a2e6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.170810 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc5d787c33f4207b3795bbfce20a2e6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.182548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc5d787c33f4207b3795bbfce20a2e6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.183176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc5d787c33f4207b3795bbfce20a2e6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.190638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0c0448d1-a46d-4985-a623-bd7656f83e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc5d787c33f4207b3795bbfce20a2e6'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.202964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1241/2486] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:03 2022] DELETE /identity/v3/users/5dc5d787c33f4207b3795bbfce20a2e6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:03.556609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:03.558349 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:03.571829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830688ab-a467-4d90-98a0-27e958d11879 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:03.634863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:03.635571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:03.635861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:03.636180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] PATH_INFO: `/v3/projects/dae65b9ef4674dac95775531d713e7d3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:03.637281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae65b9ef4674dac95775531d713e7d3)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:03.639165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:03.686155 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae65b9ef4674dac95775531d713e7d3', 'request_id': 'req-a3a690f3-a997-4668-9eb6-81e26339d3f9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.692135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae65b9ef4674dac95775531d713e7d3', 'request_id': 'req-a3a690f3-a997-4668-9eb6-81e26339d3f9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.703692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae65b9ef4674dac95775531d713e7d3', 'request_id': 'req-a3a690f3-a997-4668-9eb6-81e26339d3f9'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.714062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] The token cache is being invalidate because project dae65b9ef4674dac95775531d713e7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:03.714370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.714995 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a3a690f3-a997-4668-9eb6-81e26339d3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:03.716449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1246/2487] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:03 2022] DELETE /identity/v3/projects/dae65b9ef4674dac95775531d713e7d3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:03.721241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef970-9666-450f-a5d5-8aebfd4cc0c4 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:03.721765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef970-9666-450f-a5d5-8aebfd4cc0c4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:03.721876 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ef970-9666-450f-a5d5-8aebfd4cc0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:03.744119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-608ef970-9666-450f-a5d5-8aebfd4cc0c4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:03.745285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-608ef970-9666-450f-a5d5-8aebfd4cc0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:03.809631 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1242/2488] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:03.817177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce432-1cb6-4895-9156-df4f52a7aefc None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:03.817479 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce432-1cb6-4895-9156-df4f52a7aefc None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:03.817769 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ce432-1cb6-4895-9156-df4f52a7aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:03.843145 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-039ce432-1cb6-4895-9156-df4f52a7aefc None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:03.844342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-039ce432-1cb6-4895-9156-df4f52a7aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:03.851446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1247/2489] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:03.856682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef970-9666-450f-a5d5-8aebfd4cc0c4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:03.865993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ef970-9666-450f-a5d5-8aebfd4cc0c4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:03.870715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:03.871292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:03.871582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:03.871862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:03.872584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:03.872910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:03.874496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:03.886664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1243/2490] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:55:03.890621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ce432-1cb6-4895-9156-df4f52a7aefc None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:03.899953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ce432-1cb6-4895-9156-df4f52a7aefc None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:03.904310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:03.904890 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:03.905206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:03.905490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:03.906118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:03.908025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:03.934745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1248/2491] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:03 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:03.938941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:03.949063 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c0cf-0b25-407d-a7a0-5b319844e2a9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.013109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.013712 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.014009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.014304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.014954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.016898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.035363 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1244/2492] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:03 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:04.039894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.049640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbb7c9-6b44-4fd1-b936-3449e174f175 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.053923 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.054503 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.055368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.055664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.056394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.058212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.068018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1249/2493] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:04.072278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.081549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505f663-4669-44f5-b5fb-fe844b9f5d85 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.086547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac929a-0155-4826-9615-114d5a2672b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.087135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac929a-0155-4826-9615-114d5a2672b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.087433 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac929a-0155-4826-9615-114d5a2672b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.087723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac929a-0155-4826-9615-114d5a2672b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.088456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac929a-0155-4826-9615-114d5a2672b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.090077 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac929a-0155-4826-9615-114d5a2672b9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.099905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1245/2494] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:04.103828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.113398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9477c3-df96-4952-8c1a-c9d174e187bd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.117834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.118637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.118928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.119219 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] PATH_INFO: `/v3/projects/c67ac278b1be4958bd762b7fe80aafbd/users/561f5b5585e349f6a991db3692bf660c/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.138529 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67ac278b1be4958bd762b7fe80aafbd, user_id=561f5b5585e349f6a991db3692bf660c, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.141150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.153864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1250/2495] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:04 2022] PUT /identity/v3/projects/c67ac278b1be4958bd762b7fe80aafbd/users/561f5b5585e349f6a991db3692bf660c/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:04.164963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af437eaf-ef41-4d58-b6fc-3b7499dd87cc None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.165268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af437eaf-ef41-4d58-b6fc-3b7499dd87cc None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.165561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af437eaf-ef41-4d58-b6fc-3b7499dd87cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.201162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-af437eaf-ef41-4d58-b6fc-3b7499dd87cc None None] MFA Rules not processed for user `561f5b5585e349f6a991db3692bf660c`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:04.202330 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-af437eaf-ef41-4d58-b6fc-3b7499dd87cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:04.280037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1246/2496] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:04.284470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.352761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bfd07-f948-40ad-a76c-d30cf17cfec4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.357127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.357718 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.358006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.358291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.358937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.360886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.387685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1251/2497] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:04 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:04.391861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af437eaf-ef41-4d58-b6fc-3b7499dd87cc None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.402142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af437eaf-ef41-4d58-b6fc-3b7499dd87cc None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.466052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.466636 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.466930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.467216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.467843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.469822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.489379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1247/2498] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:04 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:04.494101 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.503859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027e5d1-f550-4a03-8285-5847592d283d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.508964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.509557 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.509845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.510127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.510820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.512423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.529640 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1252/2499] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:04.535169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.545642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd5db-3a12-4adf-aab3-417d139f39db admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.550415 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.551228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.551516 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.551800 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] PATH_INFO: `/v3/projects/068229c3c4d64441b36a0db6255ec9ad/users/3346962f30324be9b64a641d2315796d/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.573169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=068229c3c4d64441b36a0db6255ec9ad, user_id=3346962f30324be9b64a641d2315796d, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.575814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.588139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1248/2500] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:04 2022] PUT /identity/v3/projects/068229c3c4d64441b36a0db6255ec9ad/users/3346962f30324be9b64a641d2315796d/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:04.592075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.601598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53b178-51e2-4ecf-a26e-a23f8cb77bfd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.665326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031e56-a866-4352-b376-694413e73a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.665853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031e56-a866-4352-b376-694413e73a00 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.666148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031e56-a866-4352-b376-694413e73a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.666435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031e56-a866-4352-b376-694413e73a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.667164 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031e56-a866-4352-b376-694413e73a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.668776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031e56-a866-4352-b376-694413e73a00 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.678445 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1253/2501] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:04.683385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.693303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd682a-42d1-4a77-9acc-4365f158c4ed admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.698265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.699066 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.699356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.699640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] PATH_INFO: `/v3/projects/068229c3c4d64441b36a0db6255ec9ad/users/3346962f30324be9b64a641d2315796d/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.701431 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068229c3c4d64441b36a0db6255ec9ad, user_id=3346962f30324be9b64a641d2315796d, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.704049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.713786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1249/2502] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:04 2022] PUT /identity/v3/projects/068229c3c4d64441b36a0db6255ec9ad/users/3346962f30324be9b64a641d2315796d/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:04.723475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76695a-6591-4d02-b8a4-0234787be545 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.723779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76695a-6591-4d02-b8a4-0234787be545 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.724111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76695a-6591-4d02-b8a4-0234787be545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.760412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-2d76695a-6591-4d02-b8a4-0234787be545 None None] MFA Rules not processed for user `3346962f30324be9b64a641d2315796d`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:04.761573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-2d76695a-6591-4d02-b8a4-0234787be545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:04.835509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1254/2503] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:04.845125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:04.846875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:04.926405 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ff4a-30ff-487d-944d-df602a7e6374 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:04.930659 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78886617-54b0-4f6a-8292-1af751668490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:04.931240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886617-54b0-4f6a-8292-1af751668490 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:04.931540 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886617-54b0-4f6a-8292-1af751668490 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:04.932119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886617-54b0-4f6a-8292-1af751668490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:04.940915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78886617-54b0-4f6a-8292-1af751668490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:04.942347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78886617-54b0-4f6a-8292-1af751668490 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:04.951713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1250/2504] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:04 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:05.834447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76695a-6591-4d02-b8a4-0234787be545 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:05.904456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76695a-6591-4d02-b8a4-0234787be545 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:05.908703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:05.909495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:05.909782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:05.910060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] PATH_INFO: `/v3/users/561f5b5585e349f6a991db3692bf660c` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:05.911144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=561f5b5585e349f6a991db3692bf660c)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:05.913074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:05.959624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561f5b5585e349f6a991db3692bf660c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.967185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561f5b5585e349f6a991db3692bf660c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.967834 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561f5b5585e349f6a991db3692bf660c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.968464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561f5b5585e349f6a991db3692bf660c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.979874 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561f5b5585e349f6a991db3692bf660c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:05.991697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1255/2505] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:05 2022] DELETE /identity/v3/users/561f5b5585e349f6a991db3692bf660c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:05.996570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:05.997080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:05.997202 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:06.019944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:06.021082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:06.087242 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1251/2506] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:06.097292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:06.098623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:06.160886 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7151-c0c7-42d0-9ff8-13ef8a57b5de admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:06.164431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:06.164939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:06.165226 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:06.165510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:06.174191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:06.175619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:06.185207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1256/2507] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:06.530216 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:06.531612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:06.543514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5ef9-7a04-4700-8ce7-1a586f3ee82d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:06.548521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:06.549455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:06.549829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:06.550139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] PATH_INFO: `/v3/projects/c67ac278b1be4958bd762b7fe80aafbd` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:06.551267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67ac278b1be4958bd762b7fe80aafbd)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:06.553189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:06.601159 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67ac278b1be4958bd762b7fe80aafbd', 'request_id': 'req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.606936 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67ac278b1be4958bd762b7fe80aafbd', 'request_id': 'req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.613890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67ac278b1be4958bd762b7fe80aafbd', 'request_id': 'req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.630051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] The token cache is being invalidate because project c67ac278b1be4958bd762b7fe80aafbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:06.630349 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.630972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.632457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1252/2508] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:06 2022] DELETE /identity/v3/projects/c67ac278b1be4958bd762b7fe80aafbd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:06.636592 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:06.645813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7852d69-a427-42be-b9ae-94767496fd98 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:06.708283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:06.709081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:06.709373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:06.709661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] PATH_INFO: `/v3/users/3346962f30324be9b64a641d2315796d` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:06.711269 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3346962f30324be9b64a641d2315796d)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:06.713198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:06.758702 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3346962f30324be9b64a641d2315796d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.766446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3346962f30324be9b64a641d2315796d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.767153 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3346962f30324be9b64a641d2315796d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.767745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3346962f30324be9b64a641d2315796d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.780078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-558cccd1-f1a1-40c9-9b67-bd679cad81f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3346962f30324be9b64a641d2315796d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:06.793565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1257/2509] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:06 2022] DELETE /identity/v3/users/3346962f30324be9b64a641d2315796d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:07.205312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.206688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:07.219662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ac7eb-dc66-4c61-810e-d004718ee7a0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:07.284602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:07.285391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.285688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.285979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] PATH_INFO: `/v3/projects/068229c3c4d64441b36a0db6255ec9ad` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.287087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] RBAC: Authorizing `identity:delete_project(project_id=068229c3c4d64441b36a0db6255ec9ad)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:07.289119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:07.336960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068229c3c4d64441b36a0db6255ec9ad', 'request_id': 'req-d4048cde-7628-4d92-a807-4abac300052a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:07.341817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068229c3c4d64441b36a0db6255ec9ad', 'request_id': 'req-d4048cde-7628-4d92-a807-4abac300052a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:07.348528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068229c3c4d64441b36a0db6255ec9ad', 'request_id': 'req-d4048cde-7628-4d92-a807-4abac300052a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:07.364382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] The token cache is being invalidate because project 068229c3c4d64441b36a0db6255ec9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:07.364671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:07.365299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d4048cde-7628-4d92-a807-4abac300052a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:07.366725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1253/2510] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:07 2022] DELETE /identity/v3/projects/068229c3c4d64441b36a0db6255ec9ad => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:07.372122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d5de-e54c-4dd9-a939-56cf9ba41c5a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.372607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d5de-e54c-4dd9-a939-56cf9ba41c5a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.372711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5d5de-e54c-4dd9-a939-56cf9ba41c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.395033 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-dac5d5de-e54c-4dd9-a939-56cf9ba41c5a None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:07.396212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-dac5d5de-e54c-4dd9-a939-56cf9ba41c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:07.460336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1258/2511] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:07.467984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e3b6-7a21-4339-b0f1-9e6326d3d60c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.468287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e3b6-7a21-4339-b0f1-9e6326d3d60c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.468576 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e3b6-7a21-4339-b0f1-9e6326d3d60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.490416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-cc19e3b6-7a21-4339-b0f1-9e6326d3d60c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:07.491563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-cc19e3b6-7a21-4339-b0f1-9e6326d3d60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:07.501374 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1254/2512] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:07.505749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d5de-e54c-4dd9-a939-56cf9ba41c5a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.519671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5d5de-e54c-4dd9-a939-56cf9ba41c5a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:07.524744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:07.525345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.525623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.525909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.526602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:07.526902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:07.528514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:07.541426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1259/2513] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:55:07.547029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e3b6-7a21-4339-b0f1-9e6326d3d60c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.557345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e3b6-7a21-4339-b0f1-9e6326d3d60c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:07.561758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:07.562338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.562629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.562916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.563547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:07.565470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:07.591590 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1255/2514] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:07 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:07.595782 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.605564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c2e6e-112c-4c7a-a931-e35eca84fe6c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:07.673998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:07.674602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.674996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.675288 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.675981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:07.677897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:07.697829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1260/2515] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:07 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:07.702403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.712281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15dce5-b678-466c-bdff-16d579745c98 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:07.716861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:07.717449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.717741 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.718026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.718723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:07.720335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:07.730318 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1256/2516] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:07.734130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.744016 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eef0b-d13c-4fc9-ac4a-eb8a41024951 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:07.748295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29919b-5c64-4c52-a59a-c54b1070ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:07.748871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29919b-5c64-4c52-a59a-c54b1070ab07 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.749158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29919b-5c64-4c52-a59a-c54b1070ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.749440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29919b-5c64-4c52-a59a-c54b1070ab07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.750124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29919b-5c64-4c52-a59a-c54b1070ab07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:07.751697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29919b-5c64-4c52-a59a-c54b1070ab07 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:07.762052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1261/2517] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:07.766017 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.775688 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a1e37-3a2f-4f4a-8886-f1cafe30c86d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:07.780108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:07.780913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.781205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.781497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] PATH_INFO: `/v3/projects/a6e40feb85f54f37bf70e48cb239a72f/users/a263eacc1fb04b82a92875cd5a89a3fe/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.803264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e40feb85f54f37bf70e48cb239a72f, user_id=a263eacc1fb04b82a92875cd5a89a3fe, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:07.806587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:07.819708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1257/2518] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:07 2022] PUT /identity/v3/projects/a6e40feb85f54f37bf70e48cb239a72f/users/a263eacc1fb04b82a92875cd5a89a3fe/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:07.829616 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8cae0-75fb-4242-bd7b-4c0a08599487 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:07.829917 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8cae0-75fb-4242-bd7b-4c0a08599487 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:07.830212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8cae0-75fb-4242-bd7b-4c0a08599487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:07.865489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8db8cae0-75fb-4242-bd7b-4c0a08599487 None None] MFA Rules not processed for user `a263eacc1fb04b82a92875cd5a89a3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:07.866650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8db8cae0-75fb-4242-bd7b-4c0a08599487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:07.937981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1262/2519] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:07.947523 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:07.949190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:08.012609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e61606-b473-4c95-80d6-408cfe9283c4 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:08.016044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5807d-705f-4ea4-b86f-d2689f707f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:08.016616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5807d-705f-4ea4-b86f-d2689f707f58 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:08.016910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5807d-705f-4ea4-b86f-d2689f707f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:08.017196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5807d-705f-4ea4-b86f-d2689f707f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:08.025803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5807d-705f-4ea4-b86f-d2689f707f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:08.027225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5807d-705f-4ea4-b86f-d2689f707f58 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:08.035902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1258/2520] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:07 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:16.991671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8cae0-75fb-4242-bd7b-4c0a08599487 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:17.104939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8cae0-75fb-4242-bd7b-4c0a08599487 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:17.109281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:17.110089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:17.110383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:17.110671 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] PATH_INFO: `/v3/users/a263eacc1fb04b82a92875cd5a89a3fe` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:17.111794 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a263eacc1fb04b82a92875cd5a89a3fe)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:17.113758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:17.161215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a263eacc1fb04b82a92875cd5a89a3fe'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.169715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a263eacc1fb04b82a92875cd5a89a3fe'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.170371 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a263eacc1fb04b82a92875cd5a89a3fe'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.170973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a263eacc1fb04b82a92875cd5a89a3fe'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.182913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a263eacc1fb04b82a92875cd5a89a3fe'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.195067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1263/2521] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:16 2022] DELETE /identity/v3/users/a263eacc1fb04b82a92875cd5a89a3fe => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:17.199471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:17.199963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:17.200102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:17.262195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:17.263360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:17.329752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1259/2522] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:17.338910 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:17.340294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:17.453382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814a613-a7cb-4d62-8dde-e4e44dd18757 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:17.457066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f3bfb-dfe0-473a-9418-4dcb16d2f325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:17.457771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f3bfb-dfe0-473a-9418-4dcb16d2f325 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:17.458069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f3bfb-dfe0-473a-9418-4dcb16d2f325 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:17.458360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f3bfb-dfe0-473a-9418-4dcb16d2f325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:17.472764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f3bfb-dfe0-473a-9418-4dcb16d2f325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:17.474216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f3bfb-dfe0-473a-9418-4dcb16d2f325 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:17.488112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1264/2523] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:17.833367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:17.834711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:17.846308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ff25e-968f-42a5-8d12-793200d10ab8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:17.850697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:17.852359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:17.853001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:17.853001 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] PATH_INFO: `/v3/projects/a6e40feb85f54f37bf70e48cb239a72f` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:17.854146 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e40feb85f54f37bf70e48cb239a72f)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:17.856058 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:17.907002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e40feb85f54f37bf70e48cb239a72f', 'request_id': 'req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.912235 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e40feb85f54f37bf70e48cb239a72f', 'request_id': 'req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.920209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e40feb85f54f37bf70e48cb239a72f', 'request_id': 'req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.941285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] The token cache is being invalidate because project a6e40feb85f54f37bf70e48cb239a72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:17.941576 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.942220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6ede0d6-7aa9-45bc-a81b-36e4091b95ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:17.943668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1260/2524] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:17 2022] DELETE /identity/v3/projects/a6e40feb85f54f37bf70e48cb239a72f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:17.948492 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feedf6-30a0-461a-9e44-d0280751ccc5 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:17.948790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feedf6-30a0-461a-9e44-d0280751ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:17.949076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61feedf6-30a0-461a-9e44-d0280751ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:17.995541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-61feedf6-30a0-461a-9e44-d0280751ccc5 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:17.996736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-61feedf6-30a0-461a-9e44-d0280751ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:18.061187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1265/2525] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:18.068691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ad89-2f34-40db-a4e9-65f92d1d8d1d None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.068997 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ad89-2f34-40db-a4e9-65f92d1d8d1d None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.069286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3ad89-2f34-40db-a4e9-65f92d1d8d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.092435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-44c3ad89-2f34-40db-a4e9-65f92d1d8d1d None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:18.093603 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-44c3ad89-2f34-40db-a4e9-65f92d1d8d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:18.100825 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1261/2526] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:18.105573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feedf6-30a0-461a-9e44-d0280751ccc5 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:18.114908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61feedf6-30a0-461a-9e44-d0280751ccc5 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:18.119537 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:18.120168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.120464 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.120751 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.121450 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:18.121755 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:18.123343 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:18.135906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1266/2527] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:55:18.140106 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ad89-2f34-40db-a4e9-65f92d1d8d1d None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:18.149781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3ad89-2f34-40db-a4e9-65f92d1d8d1d None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:18.154311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:18.154906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.155315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.155611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.156314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:18.158221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:18.189043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1262/2528] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:18 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:18.190237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:18.200831 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef37d-e420-403f-93bc-b2512013bb7d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:18.277883 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:18.278406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.278698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.278985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.279627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:18.281694 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:18.304507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1267/2529] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:18 2022] POST /identity/v3/users => generated 281 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:18.306004 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:18.315984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a8df0-cfc8-4de3-8b98-c373fcc917bd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:18.320996 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:18.321588 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.321886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.322175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.322877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:18.324525 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:18.335115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1263/2530] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:18.339462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:18.349113 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfa53a-61a3-473a-b589-edd74b75f856 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:18.353506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae000d-a4ee-4723-90b8-fb467b5a7760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:18.354092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae000d-a4ee-4723-90b8-fb467b5a7760 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.354382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae000d-a4ee-4723-90b8-fb467b5a7760 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.354667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae000d-a4ee-4723-90b8-fb467b5a7760 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.355360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae000d-a4ee-4723-90b8-fb467b5a7760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:18.356973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae000d-a4ee-4723-90b8-fb467b5a7760 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:18.367170 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1268/2531] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:18.371167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:18.381046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84eca0-04f2-4634-b4a1-deee2bad5147 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:18.386519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646ae02-4fc3-45d7-a028-e77f7ad28014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:18.387370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ae02-4fc3-45d7-a028-e77f7ad28014 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.387661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ae02-4fc3-45d7-a028-e77f7ad28014 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.388124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ae02-4fc3-45d7-a028-e77f7ad28014 admin admin] PATH_INFO: `/v3/projects/7402b37910404f759bb10df870b83aae/users/b7cb63da2d894166a9d234176eeb57ad/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.408153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646ae02-4fc3-45d7-a028-e77f7ad28014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7402b37910404f759bb10df870b83aae, user_id=b7cb63da2d894166a9d234176eeb57ad, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:18.410774 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646ae02-4fc3-45d7-a028-e77f7ad28014 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:18.423474 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1264/2532] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:18 2022] PUT /identity/v3/projects/7402b37910404f759bb10df870b83aae/users/b7cb63da2d894166a9d234176eeb57ad/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:18.434934 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003cac8-c9a8-40fe-955e-d4c738da7f3d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.435233 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003cac8-c9a8-40fe-955e-d4c738da7f3d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.435539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003cac8-c9a8-40fe-955e-d4c738da7f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.473156 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-6003cac8-c9a8-40fe-955e-d4c738da7f3d None None] MFA Rules not processed for user `b7cb63da2d894166a9d234176eeb57ad`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:18.474372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6003cac8-c9a8-40fe-955e-d4c738da7f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:18.559306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1269/2533] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:18 2022] POST /identity/v3/auth/tokens => generated 3668 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:18.593240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43cf2d-cc5e-4764-b211-b0cd2f6224df None None] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.593635 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43cf2d-cc5e-4764-b211-b0cd2f6224df None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.594338 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43cf2d-cc5e-4764-b211-b0cd2f6224df None None] PATH_INFO: `/` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.595813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1265/2534] 10.222.0.23 () {54 vars in 961 bytes} [Fri Apr 8 02:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 08 02:55:18.600783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5df52-e017-4ca9-b338-bf5b13735b7d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.601185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5df52-e017-4ca9-b338-bf5b13735b7d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.602070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5df52-e017-4ca9-b338-bf5b13735b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.657214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c3b5df52-e017-4ca9-b338-bf5b13735b7d None None] MFA Rules not processed for user `0e240ede71df43708e2fb859c99b0a23`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:18.658482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c3b5df52-e017-4ca9-b338-bf5b13735b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:18.724484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1270/2535] 10.222.0.23 () {58 vars in 1058 bytes} [Fri Apr 8 02:55:18 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:18.733489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43cf2d-cc5e-4764-b211-b0cd2f6224df None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:18.744584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43cf2d-cc5e-4764-b211-b0cd2f6224df None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:18.748472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b4b36-a735-48b8-ab48-b2c3653e8480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:18.749052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4b36-a735-48b8-ab48-b2c3653e8480 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:18.749348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4b36-a735-48b8-ab48-b2c3653e8480 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:18.749628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b4b36-a735-48b8-ab48-b2c3653e8480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:18.758257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4b36-a735-48b8-ab48-b2c3653e8480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:18.759689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b4b36-a735-48b8-ab48-b2c3653e8480 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:18.769132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1266/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:18 2022] GET /identity/v3/auth/tokens => generated 3668 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:19.051204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5df52-e017-4ca9-b338-bf5b13735b7d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:19.124163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5df52-e017-4ca9-b338-bf5b13735b7d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:19.128465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:19.129290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:19.129604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:19.129873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] PATH_INFO: `/v3/users/b7cb63da2d894166a9d234176eeb57ad` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:19.131010 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7cb63da2d894166a9d234176eeb57ad)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:19.133637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:19.185185 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7cb63da2d894166a9d234176eeb57ad'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.192716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7cb63da2d894166a9d234176eeb57ad'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.193378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7cb63da2d894166a9d234176eeb57ad'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.193980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7cb63da2d894166a9d234176eeb57ad'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.206095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7cb63da2d894166a9d234176eeb57ad'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.218978 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1271/2537] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:19 2022] DELETE /identity/v3/users/b7cb63da2d894166a9d234176eeb57ad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:19.223522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:19.223816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:19.224176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:19.247006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:19.248395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:19.319206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1267/2538] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:19.330506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:19.331859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:19.405968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f162c9-2232-43ee-b889-a0b459afc8a7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:19.410107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34679aef-bcc2-4dd2-bc55-8c3475d9f92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:19.410773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34679aef-bcc2-4dd2-bc55-8c3475d9f92c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:19.411131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34679aef-bcc2-4dd2-bc55-8c3475d9f92c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:19.411487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34679aef-bcc2-4dd2-bc55-8c3475d9f92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:19.423289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34679aef-bcc2-4dd2-bc55-8c3475d9f92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:19.424959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34679aef-bcc2-4dd2-bc55-8c3475d9f92c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:19.436924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1272/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:19.856225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:19.857607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:19.873306 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3521a5c-a67e-4d0f-8052-ba1301ccce5c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:19.877967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:19.879112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:19.879390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:19.879681 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] PATH_INFO: `/v3/projects/7402b37910404f759bb10df870b83aae` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:19.881250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7402b37910404f759bb10df870b83aae)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:19.883361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:19.948776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7402b37910404f759bb10df870b83aae', 'request_id': 'req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.956243 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7402b37910404f759bb10df870b83aae', 'request_id': 'req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.970640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7402b37910404f759bb10df870b83aae', 'request_id': 'req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.988611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] The token cache is being invalidate because project 7402b37910404f759bb10df870b83aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:19.988882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.989524 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d0696d9d-180d-4a76-bd61-2cb0e21a57ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:19.992284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1268/2540] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:19 2022] DELETE /identity/v3/projects/7402b37910404f759bb10df870b83aae => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:19.997855 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99ec5-f7ff-46b0-bbf2-9dfdad7bdcc4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:19.998160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99ec5-f7ff-46b0-bbf2-9dfdad7bdcc4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:19.998481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a99ec5-f7ff-46b0-bbf2-9dfdad7bdcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.023546 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-93a99ec5-f7ff-46b0-bbf2-9dfdad7bdcc4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:20.024741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-93a99ec5-f7ff-46b0-bbf2-9dfdad7bdcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:20.100151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1273/2541] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:20.108528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f17a6-421b-4df1-90e1-cfc6f3427ba4 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.108846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f17a6-421b-4df1-90e1-cfc6f3427ba4 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.109139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f17a6-421b-4df1-90e1-cfc6f3427ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.133290 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-995f17a6-421b-4df1-90e1-cfc6f3427ba4 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:20.134455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-995f17a6-421b-4df1-90e1-cfc6f3427ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:20.143817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1269/2542] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:20.148376 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99ec5-f7ff-46b0-bbf2-9dfdad7bdcc4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:20.158818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a99ec5-f7ff-46b0-bbf2-9dfdad7bdcc4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:20.164516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:20.165869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.166274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.166576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.167514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:20.167877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:20.169707 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:20.189868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1274/2543] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:55:20.194500 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f17a6-421b-4df1-90e1-cfc6f3427ba4 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:20.205956 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f17a6-421b-4df1-90e1-cfc6f3427ba4 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:20.211176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:20.212047 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.212351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.212644 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.213304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:20.216071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:20.255912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1270/2544] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:20 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:20.257029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:20.266731 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86a164-59d0-4b1e-bf0d-be9082648604 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:20.330015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:20.330535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.330830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.331115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.331754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:20.333684 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:20.354250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1275/2545] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:20 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:20.358438 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:20.368391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9a81a-f005-457a-ba6d-86dc579548c5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:20.372877 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:20.373536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.373895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.374182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.374878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:20.376494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:20.386709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1271/2546] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:20.390833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:20.401229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e69165-5beb-4c99-bf9f-9ba178ebe421 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:20.405636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94c6eb-f683-48dc-9c67-a34ced9e5e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:20.406222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94c6eb-f683-48dc-9c67-a34ced9e5e46 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.406513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94c6eb-f683-48dc-9c67-a34ced9e5e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.406798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94c6eb-f683-48dc-9c67-a34ced9e5e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.407539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94c6eb-f683-48dc-9c67-a34ced9e5e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:20.409165 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94c6eb-f683-48dc-9c67-a34ced9e5e46 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:20.419331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1276/2547] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:20.423558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:20.434137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469e295-20d7-4118-a750-7a8194f29cff admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:20.438534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:20.439356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.439772 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.439985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] PATH_INFO: `/v3/projects/db379f877ebf4bda8bcef28d03d0e3bb/users/38c39d689d5b4a848bbab29270c58318/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.460784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db379f877ebf4bda8bcef28d03d0e3bb, user_id=38c39d689d5b4a848bbab29270c58318, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:20.463421 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:20.477121 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1272/2548] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:20 2022] PUT /identity/v3/projects/db379f877ebf4bda8bcef28d03d0e3bb/users/38c39d689d5b4a848bbab29270c58318/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:20.481875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.482178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.482465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.504971 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:20.506178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:20.584509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1277/2549] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:20.594692 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:20.596510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:20.662639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bc75a-3d81-492c-99c9-29ce85ae794c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:20.666843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d312319-6585-427a-aa9b-300be157aa35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:20.667429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d312319-6585-427a-aa9b-300be157aa35 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:20.667722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d312319-6585-427a-aa9b-300be157aa35 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:20.668036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d312319-6585-427a-aa9b-300be157aa35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:20.677501 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d312319-6585-427a-aa9b-300be157aa35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:20.678941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d312319-6585-427a-aa9b-300be157aa35 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:20.690291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1273/2550] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:25.023736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:25.025803 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:25.038984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def8160-4d28-484f-99eb-ca0bf13243e3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:25.042872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:25.043666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:25.044402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:25.044697 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:25.046918 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:25.059859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:25.061336 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:25.071895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1278/2551] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:25 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:26.570175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17fae7-6476-44ce-9f2a-b248aba8c279 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:26.570743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17fae7-6476-44ce-9f2a-b248aba8c279 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:26.570844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17fae7-6476-44ce-9f2a-b248aba8c279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:26.615350 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-fd17fae7-6476-44ce-9f2a-b248aba8c279 None None] MFA Rules not processed for user `38c39d689d5b4a848bbab29270c58318`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:26.617183 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-fd17fae7-6476-44ce-9f2a-b248aba8c279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:26.703730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1274/2552] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:26 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:26.707778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:26.718179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04c074-d058-4745-b494-ff063ad25773 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:26.722825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:26.723667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:26.724213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:26.724675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:26.725332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:26.727802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:26.765732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1279/2553] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:26 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:26.769926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17fae7-6476-44ce-9f2a-b248aba8c279 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:26.782212 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17fae7-6476-44ce-9f2a-b248aba8c279 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:26.856347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:26.856960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:26.857254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:26.857541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:26.858194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:26.861176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:26.891788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1275/2554] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:26 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:26.895775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:26.908018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13413c-380b-4d18-9bd8-955ab9a93757 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:26.912720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:26.913499 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:26.914213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:26.914213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:26.914852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:26.916732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:26.932186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1280/2555] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:26.933764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:26.951981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6a5cd-f670-461a-9f99-2e519a4b6f8b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:26.984251 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:26.985095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:26.985387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:26.985672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] PATH_INFO: `/v3/projects/c0c97ec02b814790879ce9c892a62ec5/users/75cf63d85a824829af05d886e27c2c43/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:27.017502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c97ec02b814790879ce9c892a62ec5, user_id=75cf63d85a824829af05d886e27c2c43, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:27.020237 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:27.042373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1276/2556] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:26 2022] PUT /identity/v3/projects/c0c97ec02b814790879ce9c892a62ec5/users/75cf63d85a824829af05d886e27c2c43/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:27.043820 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:27.057690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8581ca-4890-4918-b0fc-3e1ab52045c2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:27.142365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:27.142895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:27.143187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:27.143474 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:27.144204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:27.145813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:27.161990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1281/2557] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:27.163153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:27.182511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b834e71-f09a-4740-b7ca-4c3003e4f817 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:27.189894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:27.190744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:27.191168 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:27.191465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] PATH_INFO: `/v3/projects/c0c97ec02b814790879ce9c892a62ec5/users/75cf63d85a824829af05d886e27c2c43/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:27.193335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c97ec02b814790879ce9c892a62ec5, user_id=75cf63d85a824829af05d886e27c2c43, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:27.197723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:27.212490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1277/2558] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:27 2022] PUT /identity/v3/projects/c0c97ec02b814790879ce9c892a62ec5/users/75cf63d85a824829af05d886e27c2c43/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:31.786854 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:31.789532 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:31.804915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4482bc-ba83-4c85-8691-e2d408e34cba admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:31.896428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:31.898196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:31.898661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:31.899137 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] PATH_INFO: `/v3/users/e8e3c70e491a4f0691f753c8e2b95e95` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:31.901428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e3c70e491a4f0691f753c8e2b95e95)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:31.904844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:31.999465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e3c70e491a4f0691f753c8e2b95e95'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.015027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e3c70e491a4f0691f753c8e2b95e95'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.016440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e3c70e491a4f0691f753c8e2b95e95'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.018382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e3c70e491a4f0691f753c8e2b95e95'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.039594 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-18b564ee-6bd1-4dd8-bbb5-1e4b4a0dbb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e3c70e491a4f0691f753c8e2b95e95'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.073783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1282/2559] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:31 2022] DELETE /identity/v3/users/e8e3c70e491a4f0691f753c8e2b95e95 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:32.625056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:32.626954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:32.647882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645772-39cb-40ca-b5f1-2c8e295526c7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:32.827142 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:32.831660 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:32.832544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:32.834032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] PATH_INFO: `/v3/projects/688b5f689e3e41249484667a939fd5f8` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:32.837370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688b5f689e3e41249484667a939fd5f8)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:32.839466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:32.922059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688b5f689e3e41249484667a939fd5f8', 'request_id': 'req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.927662 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688b5f689e3e41249484667a939fd5f8', 'request_id': 'req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.951129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688b5f689e3e41249484667a939fd5f8', 'request_id': 'req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.990602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] The token cache is being invalidate because project 688b5f689e3e41249484667a939fd5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:32.990916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.993499 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-17ac288a-1a6a-4fdd-b934-9e9a877a9d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:32.998584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1278/2560] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:32 2022] DELETE /identity/v3/projects/688b5f689e3e41249484667a939fd5f8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:33.000368 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59450b-9811-4ed9-8c2d-d2fc6bc444ad None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.000863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59450b-9811-4ed9-8c2d-d2fc6bc444ad None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.001062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59450b-9811-4ed9-8c2d-d2fc6bc444ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.051982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8f59450b-9811-4ed9-8c2d-d2fc6bc444ad None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:33.053187 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8f59450b-9811-4ed9-8c2d-d2fc6bc444ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:33.196117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1283/2561] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:33.203918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98738355-70bc-49f7-8435-05bf3a7a2c3b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.204461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98738355-70bc-49f7-8435-05bf3a7a2c3b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.204916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98738355-70bc-49f7-8435-05bf3a7a2c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.232147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-98738355-70bc-49f7-8435-05bf3a7a2c3b None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:33.233435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-98738355-70bc-49f7-8435-05bf3a7a2c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:33.245891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1279/2562] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:33.247124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59450b-9811-4ed9-8c2d-d2fc6bc444ad None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:33.256900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59450b-9811-4ed9-8c2d-d2fc6bc444ad None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:33.269075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:33.269951 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.270417 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.270859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.271729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:33.272223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:33.274589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:33.316208 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1284/2563] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:55:33.321056 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98738355-70bc-49f7-8435-05bf3a7a2c3b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:33.333654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98738355-70bc-49f7-8435-05bf3a7a2c3b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:33.344123 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:33.344943 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.345803 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.346897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.347619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:33.354085 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:33.416536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1280/2564] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:33 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:33.420841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:33.436863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec464-bbb9-4c3f-afa3-f2243f5ae8ac admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:33.627031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:33.627656 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.627969 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.628257 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.628956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:33.630906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:33.675222 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1285/2565] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:33 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:33.680557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:33.696908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aa67f-1779-4244-9489-ccd6918496ef admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:33.708357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:33.708982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.709273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.709558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.711514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:33.716623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:33.739967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1281/2566] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:33.743128 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:33.755294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c3c4-3d0f-4589-903b-acb3e54a7439 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:33.767332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaac090-6946-4e4e-8a76-c0e296e5904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:33.768873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac090-6946-4e4e-8a76-c0e296e5904a admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.769475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac090-6946-4e4e-8a76-c0e296e5904a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.770355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaac090-6946-4e4e-8a76-c0e296e5904a admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.771299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaac090-6946-4e4e-8a76-c0e296e5904a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:33.774235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaac090-6946-4e4e-8a76-c0e296e5904a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:33.789398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1286/2567] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:33.793498 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:33.803819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c210d-b583-47af-925f-123b871f8b2b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:33.808489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:33.809437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.809739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.810020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] PATH_INFO: `/v3/projects/adc7cb084e9444099474d4186e32b7c2/users/4b7f9e244258459f8e6ead8617a39619/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.844630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc7cb084e9444099474d4186e32b7c2, user_id=4b7f9e244258459f8e6ead8617a39619, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:33.847782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:33.869312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1282/2568] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:33 2022] PUT /identity/v3/projects/adc7cb084e9444099474d4186e32b7c2/users/4b7f9e244258459f8e6ead8617a39619/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:33.880372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ffb1-c2f8-4a76-9117-d1cb2be426b4 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:33.880928 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ffb1-c2f8-4a76-9117-d1cb2be426b4 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:33.881378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ffb1-c2f8-4a76-9117-d1cb2be426b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:33.962566 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-5c08ffb1-c2f8-4a76-9117-d1cb2be426b4 None None] MFA Rules not processed for user `4b7f9e244258459f8e6ead8617a39619`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:33.966994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-5c08ffb1-c2f8-4a76-9117-d1cb2be426b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:34.113301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1287/2569] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:33 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:34.125175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:34.126821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:34.253944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74349f6-0404-4fa2-abf9-b16b62bc0d5f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:34.260729 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb24857-791d-4358-b13b-a8f5234c78a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:34.261456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb24857-791d-4358-b13b-a8f5234c78a9 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:34.261840 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb24857-791d-4358-b13b-a8f5234c78a9 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:34.262189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb24857-791d-4358-b13b-a8f5234c78a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:34.272912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb24857-791d-4358-b13b-a8f5234c78a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:34.274975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb24857-791d-4358-b13b-a8f5234c78a9 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:34.285461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1283/2570] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:34 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:34.644052 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ffb1-c2f8-4a76-9117-d1cb2be426b4 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:34.730706 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ffb1-c2f8-4a76-9117-d1cb2be426b4 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:34.736723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:34.737534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:34.737817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:34.738095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] PATH_INFO: `/v3/users/4b7f9e244258459f8e6ead8617a39619` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:34.739206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7f9e244258459f8e6ead8617a39619)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:34.742015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:34.807242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7f9e244258459f8e6ead8617a39619'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:34.815188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7f9e244258459f8e6ead8617a39619'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:34.815909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7f9e244258459f8e6ead8617a39619'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:34.816629 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7f9e244258459f8e6ead8617a39619'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:34.835412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa03029-e3a9-45c0-b174-3008673ff5b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7f9e244258459f8e6ead8617a39619'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:34.854835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1288/2571] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:34 2022] DELETE /identity/v3/users/4b7f9e244258459f8e6ead8617a39619 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:34.857429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:34.857917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:34.858105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:34.887522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e6416-b568-4431-9738-2611bd315c0d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:34.887819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e6416-b568-4431-9738-2611bd315c0d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:34.888186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e6416-b568-4431-9738-2611bd315c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:34.888932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:34.890197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:34.924379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-479e6416-b568-4431-9738-2611bd315c0d None None] MFA Rules not processed for user `75cf63d85a824829af05d886e27c2c43`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:34.925536 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-479e6416-b568-4431-9738-2611bd315c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:34.956818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1284/2572] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:34.968377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:34.969795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.004005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1289/2573] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:34 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:35.016747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e6416-b568-4431-9738-2611bd315c0d None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:35.018099 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-479e6416-b568-4431-9738-2611bd315c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.040297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372c69e-24af-4684-9fcb-8f8fc7565851 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:35.043946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697fbc5-df78-4af4-bb92-fbb846ebc6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:35.044561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fbc5-df78-4af4-bb92-fbb846ebc6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.044858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fbc5-df78-4af4-bb92-fbb846ebc6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.045150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fbc5-df78-4af4-bb92-fbb846ebc6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.060258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697fbc5-df78-4af4-bb92-fbb846ebc6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:35.061783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697fbc5-df78-4af4-bb92-fbb846ebc6b0 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:35.077575 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1285/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:35.094549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e6416-b568-4431-9738-2611bd315c0d None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:35.102416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbc37924fca422ea9b4865259c740f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:35.103195 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.103585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.104092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.106110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.183214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:35.184770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:35.198192 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1290/2575] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:35 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:35.359291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.359583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.360067 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.390750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:35.392705 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.500729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:35.502456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1286/2576] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:35.502585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.530173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827b64e-c533-42bd-947c-94f3b3bc8b34 service glance] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:35.540771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:35.544925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.545300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.545981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] PATH_INFO: `/v3/projects/adc7cb084e9444099474d4186e32b7c2` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.546982 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc7cb084e9444099474d4186e32b7c2)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:35.549970 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:35.566533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:35.568104 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.616689 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc7cb084e9444099474d4186e32b7c2', 'request_id': 'req-3107c7c4-7cd9-48b7-9631-956a6ec04faf'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:35.628527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc7cb084e9444099474d4186e32b7c2', 'request_id': 'req-3107c7c4-7cd9-48b7-9631-956a6ec04faf'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:35.644765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc7cb084e9444099474d4186e32b7c2', 'request_id': 'req-3107c7c4-7cd9-48b7-9631-956a6ec04faf'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:35.659087 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] The token cache is being invalidate because project adc7cb084e9444099474d4186e32b7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:35.659470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:35.660476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-3107c7c4-7cd9-48b7-9631-956a6ec04faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:35.662293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b8906-7ab9-4c13-9dd6-6e5d3cc9573c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:35.662505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1291/2577] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:35 2022] DELETE /identity/v3/projects/adc7cb084e9444099474d4186e32b7c2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:35.667784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe664-821f-441b-9cd5-affae4f446f2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.668370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe664-821f-441b-9cd5-affae4f446f2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.668869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe664-821f-441b-9cd5-affae4f446f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.699802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-666fe664-821f-441b-9cd5-affae4f446f2 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:35.701070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-666fe664-821f-441b-9cd5-affae4f446f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.744045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:35.744726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.745191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.745548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.747387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.785365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1292/2578] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:35.793691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeef33-6e0e-4140-9a94-7308896164f1 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.793989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeef33-6e0e-4140-9a94-7308896164f1 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.794275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaeef33-6e0e-4140-9a94-7308896164f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.818382 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-3eaeef33-6e0e-4140-9a94-7308896164f1 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:35.820268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3eaeef33-6e0e-4140-9a94-7308896164f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:35.824785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:35.826615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:35.829762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1293/2579] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:35.833998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaeef33-6e0e-4140-9a94-7308896164f1 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:35.837530 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1287/2580] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:55:35.843160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaeef33-6e0e-4140-9a94-7308896164f1 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:35.848129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:35.848730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.849024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.849305 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.850014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:35.850308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:35.852680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:35.876921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1294/2581] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:55:35.878862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:35.895911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5ebac-d3a5-4995-8a84-8215d8e57d5c service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:35.901144 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:35.901746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:35.902043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:35.902332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:35.902987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:35.905297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:35.943220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1288/2582] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:35 2022] POST /identity/v3/projects => generated 403 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:35.947617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:35.964722 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52986a5-38b2-47bc-bcab-2c8004534921 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:36.063670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:36.064326 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:36.064621 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:36.064915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:36.065605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:36.068726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:36.099871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:36.113216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1295/2583] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:35 2022] POST /identity/v3/users => generated 302 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:36.121034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2438-af00-43c2-bef3-1704ea80aa84 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:36.128697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:36.129314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:36.129613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:36.129918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:36.130615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:36.134959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:36.156302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1289/2584] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:36.159881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:36.176359 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406969-9df9-4113-81bf-46a9e8952eae admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:36.183133 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf2aeb-84d9-46f5-be36-7935860551eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:36.183745 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2aeb-84d9-46f5-be36-7935860551eb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:36.184317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2aeb-84d9-46f5-be36-7935860551eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:36.184317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf2aeb-84d9-46f5-be36-7935860551eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:36.185038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2aeb-84d9-46f5-be36-7935860551eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:36.186747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf2aeb-84d9-46f5-be36-7935860551eb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:36.206563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:36.206892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1296/2585] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:36.224562 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9fee3-34c6-4c31-963a-a3a52cae1570 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:36.231600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:36.234782 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:36.235375 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:36.235892 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] PATH_INFO: `/v3/projects/5682c3006d074b508671584dc67adfb4/users/2947047f7ec74e1194643f9bf5d8ef6c/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:36.273369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5682c3006d074b508671584dc67adfb4, user_id=2947047f7ec74e1194643f9bf5d8ef6c, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:36.276511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:36.299973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1290/2586] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:36 2022] PUT /identity/v3/projects/5682c3006d074b508671584dc67adfb4/users/2947047f7ec74e1194643f9bf5d8ef6c/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:36.303378 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ee67-8b7d-4a90-8038-d9f94303d2df None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:36.304505 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ee67-8b7d-4a90-8038-d9f94303d2df None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:36.304954 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3ee67-8b7d-4a90-8038-d9f94303d2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:36.335861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-44f3ee67-8b7d-4a90-8038-d9f94303d2df None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:36.337069 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-44f3ee67-8b7d-4a90-8038-d9f94303d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:36.442880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1297/2587] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:36.453200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:36.454909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:36.550984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc280b0-8eb4-4d8f-bb3e-0cfc8db55ba5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:36.555549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:36.556244 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:36.556544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:36.557536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:36.570536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:36.572052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:36.582268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1291/2588] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:37.693298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628f40-fcab-432d-a76a-77172f31df25 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:37.693775 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628f40-fcab-432d-a76a-77172f31df25 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:37.694074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628f40-fcab-432d-a76a-77172f31df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:37.742666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-ae628f40-fcab-432d-a76a-77172f31df25 None None] MFA Rules not processed for user `2947047f7ec74e1194643f9bf5d8ef6c`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:37.744091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ae628f40-fcab-432d-a76a-77172f31df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:37.862279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1298/2589] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:37 2022] POST /identity/v3/auth/tokens => generated 3710 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:37.867895 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:37.880928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52206cd-b52f-4547-9c92-2d2f87201955 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:37.887722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:37.888503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:37.888946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:37.889297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:37.891612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:37.892297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:37.930544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1292/2590] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:37 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:37.931302 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628f40-fcab-432d-a76a-77172f31df25 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:37.946246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628f40-fcab-432d-a76a-77172f31df25 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:38.030893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:38.031533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:38.031814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:38.032149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:38.032973 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:38.035528 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:38.064730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1299/2591] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:37 2022] POST /identity/v3/users => generated 309 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:38.069086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:38.081167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f19d1-dfdb-4498-beaa-4a5b637c24ef admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:38.087113 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:38.087972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:38.088271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:38.088558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:38.090107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:38.091798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:38.104021 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1293/2592] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:38.108551 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:38.121415 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae7455-7a4f-4923-b430-61099ef95033 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:38.126367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:38.127201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:38.127624 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:38.128100 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] PATH_INFO: `/v3/projects/b4a82c9831b145d1b46e2ab0d36bb0f4/users/52a9b398ec774478b816d7253b9eaa56/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:38.151984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a82c9831b145d1b46e2ab0d36bb0f4, user_id=52a9b398ec774478b816d7253b9eaa56, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:38.154628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:38.187999 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1300/2593] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:38 2022] PUT /identity/v3/projects/b4a82c9831b145d1b46e2ab0d36bb0f4/users/52a9b398ec774478b816d7253b9eaa56/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:38.191839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:38.208749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ddc0-248d-4810-b1dd-575309aa4346 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:38.311814 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7adcbe-5345-4a02-b53a-135a245221a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:38.312738 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adcbe-5345-4a02-b53a-135a245221a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:38.313132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adcbe-5345-4a02-b53a-135a245221a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:38.313528 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adcbe-5345-4a02-b53a-135a245221a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:38.314343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7adcbe-5345-4a02-b53a-135a245221a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:38.316538 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7adcbe-5345-4a02-b53a-135a245221a9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:38.333491 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1294/2594] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:38.338399 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:38.355212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6732b-54eb-4487-91da-573ffbc5a287 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:38.360713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:38.361550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:38.361843 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:38.362126 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] PATH_INFO: `/v3/projects/b4a82c9831b145d1b46e2ab0d36bb0f4/users/52a9b398ec774478b816d7253b9eaa56/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:38.371423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a82c9831b145d1b46e2ab0d36bb0f4, user_id=52a9b398ec774478b816d7253b9eaa56, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:38.374124 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:38.404231 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1301/2595] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:38 2022] PUT /identity/v3/projects/b4a82c9831b145d1b46e2ab0d36bb0f4/users/52a9b398ec774478b816d7253b9eaa56/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:39.549191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85668-ba7d-4318-857d-7d77dac3d30b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:39.549580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85668-ba7d-4318-857d-7d77dac3d30b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:39.549763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85668-ba7d-4318-857d-7d77dac3d30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:39.598385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-0cf85668-ba7d-4318-857d-7d77dac3d30b None None] MFA Rules not processed for user `52a9b398ec774478b816d7253b9eaa56`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:39.602098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0cf85668-ba7d-4318-857d-7d77dac3d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:39.752052 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1295/2596] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:39 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:41.889510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:41.975754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8fc89-e856-4fa1-8be9-f79407f5a5c0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:41.981150 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:41.982118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:41.982733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:41.982733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] PATH_INFO: `/v3/users/2947047f7ec74e1194643f9bf5d8ef6c` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:41.984223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2947047f7ec74e1194643f9bf5d8ef6c)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:41.986216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:42.044662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2947047f7ec74e1194643f9bf5d8ef6c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.053045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2947047f7ec74e1194643f9bf5d8ef6c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.054489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2947047f7ec74e1194643f9bf5d8ef6c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.055241 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2947047f7ec74e1194643f9bf5d8ef6c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.069236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2947047f7ec74e1194643f9bf5d8ef6c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.087833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1302/2597] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:41 2022] DELETE /identity/v3/users/2947047f7ec74e1194643f9bf5d8ef6c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:42.367126 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf85668-ba7d-4318-857d-7d77dac3d30b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:42.386524 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf85668-ba7d-4318-857d-7d77dac3d30b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:42.497789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:42.498839 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:42.499232 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:42.499610 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] PATH_INFO: `/v3/projects/5682c3006d074b508671584dc67adfb4` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:42.501269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5682c3006d074b508671584dc67adfb4)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:42.503737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:42.575764 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5682c3006d074b508671584dc67adfb4', 'request_id': 'req-e990ef08-5a2b-49b0-8e12-8e5350026b0b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.580830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5682c3006d074b508671584dc67adfb4', 'request_id': 'req-e990ef08-5a2b-49b0-8e12-8e5350026b0b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.588984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5682c3006d074b508671584dc67adfb4', 'request_id': 'req-e990ef08-5a2b-49b0-8e12-8e5350026b0b'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.608602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] The token cache is being invalidate because project 5682c3006d074b508671584dc67adfb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:42.609143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.610124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.611735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1296/2598] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:42 2022] DELETE /identity/v3/projects/5682c3006d074b508671584dc67adfb4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:42.616062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:42.617961 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:42.633275 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7108d2a-bee3-456b-934f-a1135c5686a8 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:42.705739 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:42.707079 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:42.707526 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:42.708021 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] PATH_INFO: `/v3/users/52a9b398ec774478b816d7253b9eaa56` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:42.709184 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a9b398ec774478b816d7253b9eaa56)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:42.711294 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:42.768840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a9b398ec774478b816d7253b9eaa56'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.777642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a9b398ec774478b816d7253b9eaa56'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.779281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a9b398ec774478b816d7253b9eaa56'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.780228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a9b398ec774478b816d7253b9eaa56'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.795637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-49a6a5c9-d1f2-4a57-b1d9-99e7edcd2a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a9b398ec774478b816d7253b9eaa56'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:42.811115 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1303/2599] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:42 2022] DELETE /identity/v3/users/52a9b398ec774478b816d7253b9eaa56 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:43.104529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:43.113186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:43.130294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ef08-5a2b-49b0-8e12-8e5350026b0b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:43.215461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:43.216626 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.217083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.217533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] PATH_INFO: `/v3/projects/b4a82c9831b145d1b46e2ab0d36bb0f4` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.218854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a82c9831b145d1b46e2ab0d36bb0f4)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:43.221022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:43.299625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a82c9831b145d1b46e2ab0d36bb0f4', 'request_id': 'req-ece08deb-713f-4e98-9c02-50d21c8c2072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:43.307872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a82c9831b145d1b46e2ab0d36bb0f4', 'request_id': 'req-ece08deb-713f-4e98-9c02-50d21c8c2072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:43.335360 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a82c9831b145d1b46e2ab0d36bb0f4', 'request_id': 'req-ece08deb-713f-4e98-9c02-50d21c8c2072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:43.361281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] The token cache is being invalidate because project b4a82c9831b145d1b46e2ab0d36bb0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:43.361600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:43.362282 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-ece08deb-713f-4e98-9c02-50d21c8c2072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:43.363749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1297/2600] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:43 2022] DELETE /identity/v3/projects/b4a82c9831b145d1b46e2ab0d36bb0f4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:43.368936 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc56c3-f7dd-4994-b7c5-e22560f53063 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.369486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc56c3-f7dd-4994-b7c5-e22560f53063 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.369591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc56c3-f7dd-4994-b7c5-e22560f53063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.393838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-97fc56c3-f7dd-4994-b7c5-e22560f53063 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:43.395034 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-97fc56c3-f7dd-4994-b7c5-e22560f53063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:43.477618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1304/2601] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:43.479465 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937dcb-95f5-4c28-908f-d3379a3feddd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.479960 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937dcb-95f5-4c28-908f-d3379a3feddd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.480070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937dcb-95f5-4c28-908f-d3379a3feddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.504443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a1937dcb-95f5-4c28-908f-d3379a3feddd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:43.505788 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a1937dcb-95f5-4c28-908f-d3379a3feddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:43.540581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1298/2602] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:43.544873 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc56c3-f7dd-4994-b7c5-e22560f53063 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:43.556202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc56c3-f7dd-4994-b7c5-e22560f53063 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:43.561647 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:43.562324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.562642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.562932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.563838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:43.564227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:43.565870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:43.583994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1305/2603] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:55:43.587185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1937dcb-95f5-4c28-908f-d3379a3feddd None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:43.597462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1937dcb-95f5-4c28-908f-d3379a3feddd None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:43.602751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:43.603430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.603797 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.604176 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.604882 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:43.606827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:43.641747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1299/2604] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:43.642997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:43.654467 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252d76-5703-455a-a112-98a84bb0ace1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:43.726541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:43.727439 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.727968 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.728409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.729246 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:43.731344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:43.759276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1306/2605] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:43 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:43.761038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:43.773743 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a7a78-b19c-4664-b2fe-5d61a2141a2c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:43.778833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:43.779439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.779757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.780078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.780828 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:43.782427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:43.800129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1300/2606] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:43.801508 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:43.812140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d810f-57e7-4f6b-a183-5d7e50b6624b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:43.820306 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada0d93-319d-4fba-9784-d15b9bcd90f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:43.821049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0d93-319d-4fba-9784-d15b9bcd90f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.821565 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0d93-319d-4fba-9784-d15b9bcd90f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.822049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0d93-319d-4fba-9784-d15b9bcd90f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.822805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada0d93-319d-4fba-9784-d15b9bcd90f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:43.824737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada0d93-319d-4fba-9784-d15b9bcd90f0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:43.843632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1307/2607] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:43.844916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:43.857390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d731c44-7783-41b0-9f55-71fbe620ca63 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:43.862095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:43.863023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.863380 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.863736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] PATH_INFO: `/v3/projects/c858f29b89c14fa6bd90d334b609e03b/users/5a14c0be5839430c8cf588b671a680f7/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.886078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c858f29b89c14fa6bd90d334b609e03b, user_id=5a14c0be5839430c8cf588b671a680f7, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:43.888829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:43.906286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1301/2608] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:43 2022] PUT /identity/v3/projects/c858f29b89c14fa6bd90d334b609e03b/users/5a14c0be5839430c8cf588b671a680f7/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:43.917462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387e2f-026b-4040-9fa2-7640ea042294 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:43.917976 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387e2f-026b-4040-9fa2-7640ea042294 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:43.918299 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08387e2f-026b-4040-9fa2-7640ea042294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:43.956805 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-08387e2f-026b-4040-9fa2-7640ea042294 None None] MFA Rules not processed for user `5a14c0be5839430c8cf588b671a680f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:43.957974 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-08387e2f-026b-4040-9fa2-7640ea042294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:44.047295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1308/2609] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:43 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:44.048154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:44.140471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d03962-e26c-4739-807d-b3ca763f9e74 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:44.145090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:44.146736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.146736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.146736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.147065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:44.150297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:44.183437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1302/2610] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:44 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:44.184865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387e2f-026b-4040-9fa2-7640ea042294 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:44.198547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08387e2f-026b-4040-9fa2-7640ea042294 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:44.274182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:44.274795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.275088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.275375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.276057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:44.277993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:44.304732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1309/2611] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:44 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:44.309511 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:44.320284 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f6154-fa5a-4cab-a9e0-d7b059f282aa admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:44.327102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:44.327708 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.328080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.328364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.329107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:44.330679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:44.352044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1303/2612] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:44.353394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:44.369041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3693-893c-418a-848c-751b0caac75d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:44.375041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:44.376029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.376388 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.376761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] PATH_INFO: `/v3/projects/ed4c2615e41948d6bec0e7fec02fc31d/users/bc96387309554427a2d02a9edc300164/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.407857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4c2615e41948d6bec0e7fec02fc31d, user_id=bc96387309554427a2d02a9edc300164, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:44.411420 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:44.429296 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1310/2613] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:44 2022] PUT /identity/v3/projects/ed4c2615e41948d6bec0e7fec02fc31d/users/bc96387309554427a2d02a9edc300164/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:44.433246 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:44.445435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7072-fce6-4801-b4fb-49da171b8f01 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:44.542404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd8a4a-4dd2-42ec-b6a9-35bfa45409c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:44.543140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8a4a-4dd2-42ec-b6a9-35bfa45409c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.543140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8a4a-4dd2-42ec-b6a9-35bfa45409c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.543418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd8a4a-4dd2-42ec-b6a9-35bfa45409c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.544175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd8a4a-4dd2-42ec-b6a9-35bfa45409c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:44.545786 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd8a4a-4dd2-42ec-b6a9-35bfa45409c3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:44.558642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1304/2614] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:44.562370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:44.573003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef74f82-6092-4aaf-b3e4-15dd79651d71 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:44.577750 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:44.578571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.578863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.579148 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] PATH_INFO: `/v3/projects/ed4c2615e41948d6bec0e7fec02fc31d/users/bc96387309554427a2d02a9edc300164/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.581086 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4c2615e41948d6bec0e7fec02fc31d, user_id=bc96387309554427a2d02a9edc300164, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:44.583686 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:44.596042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1311/2615] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:44 2022] PUT /identity/v3/projects/ed4c2615e41948d6bec0e7fec02fc31d/users/bc96387309554427a2d02a9edc300164/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:44.608784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426d5b5-86f0-4427-9c54-77872d1f475e None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.609259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426d5b5-86f0-4427-9c54-77872d1f475e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.609664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426d5b5-86f0-4427-9c54-77872d1f475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.654408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d426d5b5-86f0-4427-9c54-77872d1f475e None None] MFA Rules not processed for user `bc96387309554427a2d02a9edc300164`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:44.655726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d426d5b5-86f0-4427-9c54-77872d1f475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:44.741258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1305/2616] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:44 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:44.751515 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:44.753401 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:44.829217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b0bb-432e-487f-a82e-9b0424e2efbc admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:44.832892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361ec32-75e5-440a-b3f4-d3c42340652e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:44.833510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ec32-75e5-440a-b3f4-d3c42340652e service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:44.833798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ec32-75e5-440a-b3f4-d3c42340652e service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:44.834084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361ec32-75e5-440a-b3f4-d3c42340652e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:44.844132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361ec32-75e5-440a-b3f4-d3c42340652e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:44.845939 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361ec32-75e5-440a-b3f4-d3c42340652e service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:44.856747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1312/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:44 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:45.424868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426d5b5-86f0-4427-9c54-77872d1f475e None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:45.518167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426d5b5-86f0-4427-9c54-77872d1f475e None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:45.527112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:45.528057 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:45.528398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:45.528689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] PATH_INFO: `/v3/users/5a14c0be5839430c8cf588b671a680f7` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:45.529813 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a14c0be5839430c8cf588b671a680f7)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:45.531855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:45.603447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a14c0be5839430c8cf588b671a680f7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:45.604574 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a14c0be5839430c8cf588b671a680f7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:45.617011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a14c0be5839430c8cf588b671a680f7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:45.617689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a14c0be5839430c8cf588b671a680f7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:45.627734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a14c0be5839430c8cf588b671a680f7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:45.643670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1306/2618] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:45 2022] DELETE /identity/v3/users/5a14c0be5839430c8cf588b671a680f7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:45.649151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:45.649668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:45.649763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:45.672622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:45.673980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:45.748657 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1313/2619] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:45.759406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:45.760872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:45.834101 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bf4b6-d926-4534-a1f5-9a0e821c7564 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:45.839175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:45.839785 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:45.840108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:45.840395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:45.850929 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:45.853108 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:45.863822 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1307/2620] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:46.277714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:46.280292 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:46.295006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffc9e6-7f6e-40ca-824c-adec5ba3c750 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:46.302763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:46.304013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:46.304598 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:46.305140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] PATH_INFO: `/v3/projects/c858f29b89c14fa6bd90d334b609e03b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:46.306489 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c858f29b89c14fa6bd90d334b609e03b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:46.308938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:46.363373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c858f29b89c14fa6bd90d334b609e03b', 'request_id': 'req-44fcbb61-60da-4268-9638-13e2ba477da0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.373754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c858f29b89c14fa6bd90d334b609e03b', 'request_id': 'req-44fcbb61-60da-4268-9638-13e2ba477da0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.385732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c858f29b89c14fa6bd90d334b609e03b', 'request_id': 'req-44fcbb61-60da-4268-9638-13e2ba477da0'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.396132 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] The token cache is being invalidate because project c858f29b89c14fa6bd90d334b609e03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:46.396424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.397599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-44fcbb61-60da-4268-9638-13e2ba477da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.399196 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1314/2621] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:46 2022] DELETE /identity/v3/projects/c858f29b89c14fa6bd90d334b609e03b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:46.403196 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:46.413482 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ab0c4-c769-4144-9f8c-2ef0fcea40d6 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:46.495294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:46.496132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:46.496434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:46.496726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] PATH_INFO: `/v3/users/bc96387309554427a2d02a9edc300164` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:46.497846 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc96387309554427a2d02a9edc300164)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:46.499850 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:46.550873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc96387309554427a2d02a9edc300164'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.551769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc96387309554427a2d02a9edc300164'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.565909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc96387309554427a2d02a9edc300164'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.566633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc96387309554427a2d02a9edc300164'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.574608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc96387309554427a2d02a9edc300164'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:46.589018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1308/2622] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:46 2022] DELETE /identity/v3/users/bc96387309554427a2d02a9edc300164 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:46.955334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb28ae-e187-4e17-8a1f-bfffb309bfff None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:46.955871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb28ae-e187-4e17-8a1f-bfffb309bfff None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:46.956027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb28ae-e187-4e17-8a1f-bfffb309bfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:46.978946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-c3fb28ae-e187-4e17-8a1f-bfffb309bfff None None] MFA Rules not processed for user `38c39d689d5b4a848bbab29270c58318`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:46.980082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c3fb28ae-e187-4e17-8a1f-bfffb309bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.022638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.024563 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.048136 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1315/2623] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:46 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:47.099194 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e2a47-1d39-497c-8ea1-14ad8008ec59 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.105501 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.106286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.106578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.106994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] PATH_INFO: `/v3/projects/ed4c2615e41948d6bec0e7fec02fc31d` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.108199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4c2615e41948d6bec0e7fec02fc31d)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.110072 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.161132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4c2615e41948d6bec0e7fec02fc31d', 'request_id': 'req-b11806a0-88f6-4584-92ae-f5755e439ad0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.166923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4c2615e41948d6bec0e7fec02fc31d', 'request_id': 'req-b11806a0-88f6-4584-92ae-f5755e439ad0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.174041 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4c2615e41948d6bec0e7fec02fc31d', 'request_id': 'req-b11806a0-88f6-4584-92ae-f5755e439ad0'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.190798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] The token cache is being invalidate because project ed4c2615e41948d6bec0e7fec02fc31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:47.191086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.191716 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b11806a0-88f6-4584-92ae-f5755e439ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:47.193466 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1309/2624] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:47 2022] DELETE /identity/v3/projects/ed4c2615e41948d6bec0e7fec02fc31d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:47.198214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de975ce2-4a83-4bd7-9632-6347978c8faa None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.198644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de975ce2-4a83-4bd7-9632-6347978c8faa None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.198998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de975ce2-4a83-4bd7-9632-6347978c8faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.223312 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-de975ce2-4a83-4bd7-9632-6347978c8faa None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:47.224633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-de975ce2-4a83-4bd7-9632-6347978c8faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.290930 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1316/2625] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:47.298880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21ced-8f92-4b65-be2b-334ef08e9fea None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.299258 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21ced-8f92-4b65-be2b-334ef08e9fea None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.299616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d21ced-8f92-4b65-be2b-334ef08e9fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.323116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-22d21ced-8f92-4b65-be2b-334ef08e9fea None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:47.324323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-22d21ced-8f92-4b65-be2b-334ef08e9fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.331514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1310/2626] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:47.336331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de975ce2-4a83-4bd7-9632-6347978c8faa None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.345932 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de975ce2-4a83-4bd7-9632-6347978c8faa None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.350619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.351210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.351496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.351776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.352538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:47.352841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.354458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.367770 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1317/2627] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:55:47.371909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d21ced-8f92-4b65-be2b-334ef08e9fea None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.380871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d21ced-8f92-4b65-be2b-334ef08e9fea None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.386173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.386795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.387081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.387364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.388064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.390178 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.420836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1311/2628] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:47.422201 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.425740 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.427353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.432650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8675c3-6e39-4846-9dde-42ddb6f39565 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.495081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc87d2a-1c91-4a92-a4c2-c3be2010780e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.497905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.498507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.498799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.498909 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.499089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.499456 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.499721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.499843 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.500064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.501695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.501808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.513185 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.514721 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.523418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1312/2629] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:47 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:55:47.526865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1318/2630] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:47.527910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.539902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7dae2b-74b0-4025-b43f-ce561ca5dceb service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.544364 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.544952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.545241 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.545526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.546220 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.547784 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.558934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1313/2631] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:47.563338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.576964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa53c3-7b45-46c4-95be-670c9a09c683 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.583338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f022d0-95e0-4544-a50f-18c1b91c8e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.584327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f022d0-95e0-4544-a50f-18c1b91c8e9d admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.585441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f022d0-95e0-4544-a50f-18c1b91c8e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.585882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f022d0-95e0-4544-a50f-18c1b91c8e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.586981 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f022d0-95e0-4544-a50f-18c1b91c8e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.589160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f022d0-95e0-4544-a50f-18c1b91c8e9d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.599712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1319/2632] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:47.604418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.614209 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65c4f5-b7c0-4979-82ee-af57ab77c1f5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.618719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.619536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.619830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.620158 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] PATH_INFO: `/v3/projects/47a8ce98ad71411dac7c7579a7ff6348/users/8c47d1c699c5418d967fa13264bc2875/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.639836 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a8ce98ad71411dac7c7579a7ff6348, user_id=8c47d1c699c5418d967fa13264bc2875, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.642531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.657323 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1314/2633] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:47 2022] PUT /identity/v3/projects/47a8ce98ad71411dac7c7579a7ff6348/users/8c47d1c699c5418d967fa13264bc2875/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:55:47.668531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9080b2-430a-4bc8-897f-07bc82143dde None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.668838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9080b2-430a-4bc8-897f-07bc82143dde None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.669122 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9080b2-430a-4bc8-897f-07bc82143dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.710858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-cd9080b2-430a-4bc8-897f-07bc82143dde None None] MFA Rules not processed for user `8c47d1c699c5418d967fa13264bc2875`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:47.712869 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cd9080b2-430a-4bc8-897f-07bc82143dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:47.793741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1320/2634] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:47.798294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.879965 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96966959-6900-4789-8512-c517313e5fcc admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:47.887333 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:47.887952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:47.888265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:47.888555 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:47.889215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:47.891130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:47.930612 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1315/2635] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:47.933097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9080b2-430a-4bc8-897f-07bc82143dde None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:47.944572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9080b2-430a-4bc8-897f-07bc82143dde None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.011801 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.012535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.012867 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.013158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.014188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.015709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:48.039218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1321/2636] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:47 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:48.041655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.052054 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18d06b-aadb-4627-9e1c-181ba437e6c0 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.057609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.058170 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.058553 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.058758 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.059446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.061071 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:48.073012 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1316/2637] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:48.077352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.087669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec19c-5587-4754-8521-b0090f85f613 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.092502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.093317 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.093610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.093900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] PATH_INFO: `/v3/projects/7457ef88b11448a08f3a3ff1f9c3afad/users/2c7ae2944ad74ae6939bf8aba0bd7dd1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.114842 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7457ef88b11448a08f3a3ff1f9c3afad, user_id=2c7ae2944ad74ae6939bf8aba0bd7dd1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.118291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:48.131764 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1322/2638] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:48 2022] PUT /identity/v3/projects/7457ef88b11448a08f3a3ff1f9c3afad/users/2c7ae2944ad74ae6939bf8aba0bd7dd1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:48.135671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.145558 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de224d-a969-437c-9efb-f323aa097191 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.212098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a9f1-b4b5-4b89-9a5d-27393c45a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.212737 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a9f1-b4b5-4b89-9a5d-27393c45a4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.213033 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a9f1-b4b5-4b89-9a5d-27393c45a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.213324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a9f1-b4b5-4b89-9a5d-27393c45a4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.214039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73a9f1-b4b5-4b89-9a5d-27393c45a4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.215717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73a9f1-b4b5-4b89-9a5d-27393c45a4a8 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:48.226007 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1317/2639] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:48.230251 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.240012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b29f7-ff7f-4240-95da-c7c9279eedfb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.245516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.246395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.246752 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.247098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] PATH_INFO: `/v3/projects/7457ef88b11448a08f3a3ff1f9c3afad/users/2c7ae2944ad74ae6939bf8aba0bd7dd1/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.249027 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7457ef88b11448a08f3a3ff1f9c3afad, user_id=2c7ae2944ad74ae6939bf8aba0bd7dd1, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.251818 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:48.263362 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1323/2640] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:48 2022] PUT /identity/v3/projects/7457ef88b11448a08f3a3ff1f9c3afad/users/2c7ae2944ad74ae6939bf8aba0bd7dd1/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:48.274386 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68612db-0f88-4b5a-89ca-937eeb81eddd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.274768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68612db-0f88-4b5a-89ca-937eeb81eddd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.275285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68612db-0f88-4b5a-89ca-937eeb81eddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.312505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c68612db-0f88-4b5a-89ca-937eeb81eddd None None] MFA Rules not processed for user `2c7ae2944ad74ae6939bf8aba0bd7dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:48.313596 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c68612db-0f88-4b5a-89ca-937eeb81eddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:48.390944 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1318/2641] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:48 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:48.401830 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.403496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:48.471289 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ef6d-e602-4eec-beb7-6f71092c6ca2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.474922 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1ce6f-facc-484f-af05-106736df0dab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.475411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1ce6f-facc-484f-af05-106736df0dab service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.475839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1ce6f-facc-484f-af05-106736df0dab service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.476160 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1ce6f-facc-484f-af05-106736df0dab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.485658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1ce6f-facc-484f-af05-106736df0dab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.487092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1ce6f-facc-484f-af05-106736df0dab service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:48.497848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1324/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:48 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:48.607630 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68612db-0f88-4b5a-89ca-937eeb81eddd None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:48.618070 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68612db-0f88-4b5a-89ca-937eeb81eddd None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:48.621546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:48.622127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:48.622424 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:48.622714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:48.688042 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:48.689487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:48.698207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1319/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:48 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:49.521205 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d934e-d993-480f-9d60-5e36ae389a79 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:49.522019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d934e-d993-480f-9d60-5e36ae389a79 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:49.522019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d934e-d993-480f-9d60-5e36ae389a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:49.545811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-937d934e-d993-480f-9d60-5e36ae389a79 None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:49.547068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-937d934e-d993-480f-9d60-5e36ae389a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:49.610870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1325/2644] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:55:49 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:49.624168 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:49.625676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:49.710014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7b879-dbbd-4fa0-b53c-e5366f02e19d service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:49.714795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9748-d799-4907-a219-01f2657cbe1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:49.715387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9748-d799-4907-a219-01f2657cbe1a service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:49.715682 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9748-d799-4907-a219-01f2657cbe1a service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:49.715999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9748-d799-4907-a219-01f2657cbe1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:49.724654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9748-d799-4907-a219-01f2657cbe1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:49.726898 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9748-d799-4907-a219-01f2657cbe1a service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:49.735023 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1320/2645] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:55:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:55:52.161329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d934e-d993-480f-9d60-5e36ae389a79 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:52.244396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d934e-d993-480f-9d60-5e36ae389a79 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:52.257660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:52.258701 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:52.259329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:52.259714 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] PATH_INFO: `/v3/users/8c47d1c699c5418d967fa13264bc2875` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:52.262060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c47d1c699c5418d967fa13264bc2875)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:52.264334 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:52.339865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c47d1c699c5418d967fa13264bc2875'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.347617 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c47d1c699c5418d967fa13264bc2875'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.348304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c47d1c699c5418d967fa13264bc2875'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.348905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c47d1c699c5418d967fa13264bc2875'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.361792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c47d1c699c5418d967fa13264bc2875'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:52.379406 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1326/2646] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:52 2022] DELETE /identity/v3/users/8c47d1c699c5418d967fa13264bc2875 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:52.384200 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:52.384792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:52.384928 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:52.410549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:52.411770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:52.488276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1321/2647] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:52.499599 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:52.501074 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:52.573513 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b6a56-2ae3-4733-93a3-fca7b2a90b87 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:52.577077 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:52.577670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:52.577963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:52.578250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:52.588683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:52.590141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:52.599373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1327/2648] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:52.980762 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:52.982302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:52.994594 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016cd6d-62bd-4c8b-9152-beb666aa8729 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:52.999096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:52.999897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.000228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.000518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] PATH_INFO: `/v3/projects/47a8ce98ad71411dac7c7579a7ff6348` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.001815 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a8ce98ad71411dac7c7579a7ff6348)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:53.003981 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:53.060353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a8ce98ad71411dac7c7579a7ff6348', 'request_id': 'req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.065747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a8ce98ad71411dac7c7579a7ff6348', 'request_id': 'req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.076059 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a8ce98ad71411dac7c7579a7ff6348', 'request_id': 'req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.094830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] The token cache is being invalidate because project 47a8ce98ad71411dac7c7579a7ff6348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:53.095218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.096014 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.097809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1322/2649] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:52 2022] DELETE /identity/v3/projects/47a8ce98ad71411dac7c7579a7ff6348 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:53.102685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:53.112776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407a2c8-eac3-4c8d-92a7-f565779f70b3 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:53.184900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:53.185813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.186177 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.186547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] PATH_INFO: `/v3/users/2c7ae2944ad74ae6939bf8aba0bd7dd1` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.187776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7ae2944ad74ae6939bf8aba0bd7dd1)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:53.189807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:53.259942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7ae2944ad74ae6939bf8aba0bd7dd1'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.268522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7ae2944ad74ae6939bf8aba0bd7dd1'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.269227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7ae2944ad74ae6939bf8aba0bd7dd1'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.269838 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7ae2944ad74ae6939bf8aba0bd7dd1'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.282372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-71430d7b-36ad-4273-aafa-b90018fdd930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7ae2944ad74ae6939bf8aba0bd7dd1'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:53.296675 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1328/2650] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:53 2022] DELETE /identity/v3/users/2c7ae2944ad74ae6939bf8aba0bd7dd1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:53.849747 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:53.851744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:53.866522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc1cc5-bc0d-48f0-bd40-c50ceee09261 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:53.962148 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:53.962958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:53.963252 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:53.963529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] PATH_INFO: `/v3/projects/7457ef88b11448a08f3a3ff1f9c3afad` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:53.965140 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7457ef88b11448a08f3a3ff1f9c3afad)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:53.967381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.028905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7457ef88b11448a08f3a3ff1f9c3afad', 'request_id': 'req-0b86c58a-22e2-459c-83eb-3df806895351'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.034664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7457ef88b11448a08f3a3ff1f9c3afad', 'request_id': 'req-0b86c58a-22e2-459c-83eb-3df806895351'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.044018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7457ef88b11448a08f3a3ff1f9c3afad', 'request_id': 'req-0b86c58a-22e2-459c-83eb-3df806895351'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.077119 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] The token cache is being invalidate because project 7457ef88b11448a08f3a3ff1f9c3afad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:54.077502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.078715 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-0b86c58a-22e2-459c-83eb-3df806895351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:54.080342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1323/2651] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:53 2022] DELETE /identity/v3/projects/7457ef88b11448a08f3a3ff1f9c3afad => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:54.085925 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91daa-50d3-4db0-929a-3119bff8fca6 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.086224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91daa-50d3-4db0-929a-3119bff8fca6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.086542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b91daa-50d3-4db0-929a-3119bff8fca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.110884 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a7b91daa-50d3-4db0-929a-3119bff8fca6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:54.112670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a7b91daa-50d3-4db0-929a-3119bff8fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:54.203186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1329/2652] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:54.211879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2b72-7ab4-41b0-a597-f23a7c0cbe62 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.212207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2b72-7ab4-41b0-a597-f23a7c0cbe62 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.212494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba2b72-7ab4-41b0-a597-f23a7c0cbe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.237280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f5ba2b72-7ab4-41b0-a597-f23a7c0cbe62 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:54.238462 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f5ba2b72-7ab4-41b0-a597-f23a7c0cbe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:54.246919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1324/2653] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:55:54.251225 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91daa-50d3-4db0-929a-3119bff8fca6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.262190 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b91daa-50d3-4db0-929a-3119bff8fca6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.266784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.267258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.267535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.267816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.268560 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:55:54.268858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.270661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.284796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1330/2654] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:55:54.291192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba2b72-7ab4-41b0-a597-f23a7c0cbe62 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.301339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba2b72-7ab4-41b0-a597-f23a7c0cbe62 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.306811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.307750 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.308141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.308667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.309458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.311426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.339300 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1325/2655] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:54 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:54.343580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.355054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44d3cd-1c3f-4008-9651-81d21866e946 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.426454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.427424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.427548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.427753 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.429098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.431047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.461510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1331/2656] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:54 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:54.465689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.485593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6cfb-1ea5-475d-a2dd-0006164d982c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.516830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.517455 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.517751 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.518043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.528305 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.530345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.544900 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1326/2657] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:54.546166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.565025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66d1fb-0bc6-426f-8efa-922d8b69d2ab admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.576682 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f1428-1e7e-40f2-9690-eaa08e21ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.577444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1428-1e7e-40f2-9690-eaa08e21ee67 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.577758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1428-1e7e-40f2-9690-eaa08e21ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.578107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f1428-1e7e-40f2-9690-eaa08e21ee67 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.578882 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1428-1e7e-40f2-9690-eaa08e21ee67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.580578 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f1428-1e7e-40f2-9690-eaa08e21ee67 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.593323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1332/2658] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:55:54.597129 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.610831 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3e80f-9bcc-4e8b-aa0a-ebc29915c157 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.619429 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.620707 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.621076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.621477 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] PATH_INFO: `/v3/projects/6fcd708b69c847d281ec7b095865d0c3/users/82ade4a6aa904bea9c07d394fcd5e5e5/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.643569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcd708b69c847d281ec7b095865d0c3, user_id=82ade4a6aa904bea9c07d394fcd5e5e5, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.646396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.666100 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1327/2659] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:54 2022] PUT /identity/v3/projects/6fcd708b69c847d281ec7b095865d0c3/users/82ade4a6aa904bea9c07d394fcd5e5e5/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:54.677248 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ee5fb-0938-491e-b4b4-231e1761655a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.677549 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ee5fb-0938-491e-b4b4-231e1761655a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.677844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ee5fb-0938-491e-b4b4-231e1761655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.723899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-7b8ee5fb-0938-491e-b4b4-231e1761655a None None] MFA Rules not processed for user `82ade4a6aa904bea9c07d394fcd5e5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:54.725525 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7b8ee5fb-0938-491e-b4b4-231e1761655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:54.840223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1333/2660] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:54 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:54.841425 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.923247 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091798c-977f-4312-97d7-ffecb74af50a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:54.933908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:54.933908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:54.933908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:54.933908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:54.934354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:54.934354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:54.962593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1328/2661] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:55:54 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:55:54.966398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ee5fb-0938-491e-b4b4-231e1761655a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:54.977534 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ee5fb-0938-491e-b4b4-231e1761655a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.051259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.051879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.052416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.052550 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.053237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.055041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:55.083974 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1334/2662] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:55:54 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:55:55.085495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.096348 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569ad35-4ccc-499a-99cc-38c1b9736952 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.101608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.102219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.102510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.102801 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.103522 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.105268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:55.117887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1329/2663] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:55.122204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.133712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded6f2-3dcc-4f8f-b4e5-d44b21dc4cb3 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.138324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.139147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.139437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.139721 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] PATH_INFO: `/v3/projects/a7d2463215114fd680f05f6737672dd9/users/e877a3651b89405ea80760ef02a1dd0f/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.161463 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d2463215114fd680f05f6737672dd9, user_id=e877a3651b89405ea80760ef02a1dd0f, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.165108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:55.188915 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1335/2664] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:55 2022] PUT /identity/v3/projects/a7d2463215114fd680f05f6737672dd9/users/e877a3651b89405ea80760ef02a1dd0f/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:55.189773 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.200450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa89754-eb5e-4641-974e-c08604388405 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.269135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e84d2-7e65-4cf4-bb25-a9c03e5941eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.269749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e84d2-7e65-4cf4-bb25-a9c03e5941eb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.270043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e84d2-7e65-4cf4-bb25-a9c03e5941eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.270332 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e84d2-7e65-4cf4-bb25-a9c03e5941eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.271043 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e84d2-7e65-4cf4-bb25-a9c03e5941eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.273505 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e84d2-7e65-4cf4-bb25-a9c03e5941eb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:55.284167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1330/2665] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:55:55.289372 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.306444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf8462-18a7-4cab-95e3-a287e63a875b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.311487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.312465 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.312761 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.313049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] PATH_INFO: `/v3/projects/a7d2463215114fd680f05f6737672dd9/users/e877a3651b89405ea80760ef02a1dd0f/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.314891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d2463215114fd680f05f6737672dd9, user_id=e877a3651b89405ea80760ef02a1dd0f, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.317559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:55.328679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1336/2666] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:55:55 2022] PUT /identity/v3/projects/a7d2463215114fd680f05f6737672dd9/users/e877a3651b89405ea80760ef02a1dd0f/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:55.338987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea70b-a03c-4f8d-a261-6c129685ce92 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.339297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea70b-a03c-4f8d-a261-6c129685ce92 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.339586 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea70b-a03c-4f8d-a261-6c129685ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.378261 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-05fea70b-a03c-4f8d-a261-6c129685ce92 None None] MFA Rules not processed for user `e877a3651b89405ea80760ef02a1dd0f`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:55.379377 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-05fea70b-a03c-4f8d-a261-6c129685ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:55.468493 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1331/2667] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:55 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:55.479092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.480849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:55.556938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3436465-ab5d-459e-b397-f822e6591845 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.564075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.564075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.564075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.564075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.574166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.575615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:55.585959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1337/2668] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:55 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:55.704207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea70b-a03c-4f8d-a261-6c129685ce92 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:55.721661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea70b-a03c-4f8d-a261-6c129685ce92 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:55.726002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6b763-d619-4046-92ae-ccfa5d4d549e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:55.726593 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6b763-d619-4046-92ae-ccfa5d4d549e service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:55.726889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6b763-d619-4046-92ae-ccfa5d4d549e service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:55.727177 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6b763-d619-4046-92ae-ccfa5d4d549e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:55.798327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6b763-d619-4046-92ae-ccfa5d4d549e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:55.800215 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6b763-d619-4046-92ae-ccfa5d4d549e service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:55.810808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1332/2669] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:55 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:58.874144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:58.943459 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb33dd1-8874-4f0e-a5d1-5d9eb8f95f23 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:58.948442 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:58.949254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:58.949547 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:58.949836 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] PATH_INFO: `/v3/users/82ade4a6aa904bea9c07d394fcd5e5e5` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:58.950959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82ade4a6aa904bea9c07d394fcd5e5e5)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:58.952943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:59.006688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82ade4a6aa904bea9c07d394fcd5e5e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.015351 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82ade4a6aa904bea9c07d394fcd5e5e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.016065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82ade4a6aa904bea9c07d394fcd5e5e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.016672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82ade4a6aa904bea9c07d394fcd5e5e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.028921 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82ade4a6aa904bea9c07d394fcd5e5e5'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.040870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1338/2670] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:58 2022] DELETE /identity/v3/users/82ade4a6aa904bea9c07d394fcd5e5e5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:59.045281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:59.045795 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:59.045901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:59.068180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:55:59.069339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:59.134088 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1333/2671] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:55:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:55:59.144846 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:59.146161 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:59.209749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41b9f7-0de3-4b6f-af0b-c454d1cb364b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:59.213183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:59.213984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:59.214311 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:59.214600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:59.223859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:59.225308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:59.234622 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1339/2672] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:55:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:55:59.596753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:59.598139 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:55:59.610449 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91522c50-9e4b-4f38-95db-169f460dc109 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:59.615180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:59.616000 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:59.616295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:59.616583 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] PATH_INFO: `/v3/projects/6fcd708b69c847d281ec7b095865d0c3` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:59.617776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcd708b69c847d281ec7b095865d0c3)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:59.619735 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:59.672566 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcd708b69c847d281ec7b095865d0c3', 'request_id': 'req-b14cf663-9744-4c53-a012-f637eda52b6d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.678805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcd708b69c847d281ec7b095865d0c3', 'request_id': 'req-b14cf663-9744-4c53-a012-f637eda52b6d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.687370 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcd708b69c847d281ec7b095865d0c3', 'request_id': 'req-b14cf663-9744-4c53-a012-f637eda52b6d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.703238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] The token cache is being invalidate because project 6fcd708b69c847d281ec7b095865d0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:55:59.703529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.704182 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.705745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1334/2673] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:55:59 2022] DELETE /identity/v3/projects/6fcd708b69c847d281ec7b095865d0c3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:55:59.709667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:55:59.719741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbb91b-1e50-4d2b-b882-37a7bc6db04c service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:55:59.784822 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:55:59.785618 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:55:59.785906 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:55:59.786189 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] PATH_INFO: `/v3/users/e877a3651b89405ea80760ef02a1dd0f` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:55:59.787285 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e877a3651b89405ea80760ef02a1dd0f)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:55:59.789258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:55:59.837715 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e877a3651b89405ea80760ef02a1dd0f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.845959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e877a3651b89405ea80760ef02a1dd0f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.846646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e877a3651b89405ea80760ef02a1dd0f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.847254 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e877a3651b89405ea80760ef02a1dd0f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.859324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-4cdec5ef-59c6-4898-b203-e9ffacfadd6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e877a3651b89405ea80760ef02a1dd0f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:55:59.873325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1340/2674] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:55:59 2022] DELETE /identity/v3/users/e877a3651b89405ea80760ef02a1dd0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:00.232543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.234029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:00.246733 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cf663-9744-4c53-a012-f637eda52b6d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.310905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.311719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.312036 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.312322 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] PATH_INFO: `/v3/projects/a7d2463215114fd680f05f6737672dd9` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.313419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d2463215114fd680f05f6737672dd9)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.315295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:00.364343 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d2463215114fd680f05f6737672dd9', 'request_id': 'req-04b30c1b-09a5-4ac8-b192-5299df56a07d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.369328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d2463215114fd680f05f6737672dd9', 'request_id': 'req-04b30c1b-09a5-4ac8-b192-5299df56a07d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.376990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d2463215114fd680f05f6737672dd9', 'request_id': 'req-04b30c1b-09a5-4ac8-b192-5299df56a07d'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.394311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] The token cache is being invalidate because project a7d2463215114fd680f05f6737672dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:00.394605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.395260 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-04b30c1b-09a5-4ac8-b192-5299df56a07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:00.396746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1335/2675] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:00 2022] DELETE /identity/v3/projects/a7d2463215114fd680f05f6737672dd9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:00.401845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de22f3-b535-45dc-b4c5-bab269e4450e None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.402274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de22f3-b535-45dc-b4c5-bab269e4450e None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.402426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de22f3-b535-45dc-b4c5-bab269e4450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.425506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b3de22f3-b535-45dc-b4c5-bab269e4450e None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:00.426655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b3de22f3-b535-45dc-b4c5-bab269e4450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:00.491795 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1341/2676] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:00.500852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb39bf-5f8e-477a-b411-07c6287c4e11 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.501154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb39bf-5f8e-477a-b411-07c6287c4e11 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.501447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb39bf-5f8e-477a-b411-07c6287c4e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.523394 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f0cb39bf-5f8e-477a-b411-07c6287c4e11 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:00.524577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f0cb39bf-5f8e-477a-b411-07c6287c4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:00.532403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1336/2677] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:00.536561 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de22f3-b535-45dc-b4c5-bab269e4450e None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.546710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de22f3-b535-45dc-b4c5-bab269e4450e None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.551452 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.552186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.552539 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.552891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.553732 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:56:00.554097 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.556173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:00.569800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1342/2678] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:56:00.574274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb39bf-5f8e-477a-b411-07c6287c4e11 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.583189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb39bf-5f8e-477a-b411-07c6287c4e11 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.587572 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.588187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.588971 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.589259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.589906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.591804 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:00.617406 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1337/2679] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:00 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:00.622037 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.631667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515fb0-b25b-4070-9f7f-ad08ff8ab09e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.703947 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.704387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.704676 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.704960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.705613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.707743 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:00.730290 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1343/2680] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:00 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:00.734346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.744411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eab562-4ed1-484a-ab0d-7f803d3c1b48 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.749381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.749982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.750276 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.750565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.751271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.752982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:00.766911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1338/2681] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:00.768228 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.778856 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b541-2442-474a-a386-090cd86be2d1 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.783482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb4ba-7ef0-4bf2-89a4-bcbb79c12f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.784210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb4ba-7ef0-4bf2-89a4-bcbb79c12f23 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.784575 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb4ba-7ef0-4bf2-89a4-bcbb79c12f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.784937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb4ba-7ef0-4bf2-89a4-bcbb79c12f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.785776 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb4ba-7ef0-4bf2-89a4-bcbb79c12f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.787432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb4ba-7ef0-4bf2-89a4-bcbb79c12f23 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:00.798699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1344/2682] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:00.802683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.813416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe3908-f9d8-4299-b4e4-48492cde16ca admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:00.818731 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:00.819579 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.819875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.820198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] PATH_INFO: `/v3/projects/1b051a844bb34a5eb22cb95898cceb82/users/7cfd085bd61d42c7a5963069b038a902/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.840796 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b051a844bb34a5eb22cb95898cceb82, user_id=7cfd085bd61d42c7a5963069b038a902, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:00.843494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:00.856584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1339/2683] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:00 2022] PUT /identity/v3/projects/1b051a844bb34a5eb22cb95898cceb82/users/7cfd085bd61d42c7a5963069b038a902/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:00.861894 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:00.862244 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:00.862542 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:00.884210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:00.885428 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:00.952002 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1345/2684] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:00.962274 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:00.964609 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:01.033628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc12573-effd-44fb-adaa-eec668d04caa admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:01.037408 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9439d-0118-4c7f-a5ba-faa62fa4b59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:01.037993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9439d-0118-4c7f-a5ba-faa62fa4b59e service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:01.038287 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9439d-0118-4c7f-a5ba-faa62fa4b59e service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:01.038577 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9439d-0118-4c7f-a5ba-faa62fa4b59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:01.048314 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9439d-0118-4c7f-a5ba-faa62fa4b59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:01.049777 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9439d-0118-4c7f-a5ba-faa62fa4b59e service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:01.061024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1340/2685] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:56:01.788579 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:01.790719 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:01.923996 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57594780-2bee-43ab-96c2-4bffa5f9c9f2 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:01.933176 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:01.933980 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:01.934346 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:01.934729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:01.936859 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:01.950186 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:01.951998 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:01.963858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1346/2686] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:01 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:02.180136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a454-89bb-45d1-8c75-45a31c62c2a9 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.180619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a454-89bb-45d1-8c75-45a31c62c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.180706 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a454-89bb-45d1-8c75-45a31c62c2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.220095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-fa86a454-89bb-45d1-8c75-45a31c62c2a9 None None] MFA Rules not processed for user `7cfd085bd61d42c7a5963069b038a902`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:02.221293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-fa86a454-89bb-45d1-8c75-45a31c62c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:02.322296 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1341/2687] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:02 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:02.328030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.345360 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dd4f2-a7ca-4805-897a-520176a5a727 service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.350541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.351142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.351437 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.351728 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.352422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.354763 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:02.387449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1347/2688] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:02 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:02.390872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86a454-89bb-45d1-8c75-45a31c62c2a9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.402090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86a454-89bb-45d1-8c75-45a31c62c2a9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.539083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.540160 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.540975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.542329 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.544236 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.548995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:02.647974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1342/2689] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:02 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:02.652841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.689709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee4910-e130-4205-84b0-41466b267656 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.698202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.699213 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.699741 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.700271 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.701236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.703075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:02.719110 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1348/2690] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:02.723544 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.736336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41923f3a-370f-4b56-9399-8c6d315a1ad2 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.742450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.743484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.743856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.744254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] PATH_INFO: `/v3/projects/51b5139f0a4041cba2d752cde9633b65/users/a2cd623899b54b2186d7443ba69336f2/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.774673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b5139f0a4041cba2d752cde9633b65, user_id=a2cd623899b54b2186d7443ba69336f2, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.778564 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:02.797571 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1343/2691] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:02 2022] PUT /identity/v3/projects/51b5139f0a4041cba2d752cde9633b65/users/a2cd623899b54b2186d7443ba69336f2/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:02.801816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.818014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd38b-316d-4d18-a9da-3fc761e3322b admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.905866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43602fca-00db-4233-a8f3-b524973f09bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.906937 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43602fca-00db-4233-a8f3-b524973f09bc admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.907410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43602fca-00db-4233-a8f3-b524973f09bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.907877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43602fca-00db-4233-a8f3-b524973f09bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.908786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43602fca-00db-4233-a8f3-b524973f09bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.910541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43602fca-00db-4233-a8f3-b524973f09bc admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:02.921081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1349/2692] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:02.925339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:02.935809 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2996a-5b36-4c45-9f7e-a197f3193014 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:02.940179 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:02.941005 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:02.941301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:02.941592 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] PATH_INFO: `/v3/projects/51b5139f0a4041cba2d752cde9633b65/users/a2cd623899b54b2186d7443ba69336f2/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:02.943379 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b5139f0a4041cba2d752cde9633b65, user_id=a2cd623899b54b2186d7443ba69336f2, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:02.946035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:02.957127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1344/2693] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:02 2022] PUT /identity/v3/projects/51b5139f0a4041cba2d752cde9633b65/users/a2cd623899b54b2186d7443ba69336f2/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:03.738375 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923409-4d59-4c93-89f8-2c81f16aa253 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.738677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923409-4d59-4c93-89f8-2c81f16aa253 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.738965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3923409-4d59-4c93-89f8-2c81f16aa253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:03.776872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b3923409-4d59-4c93-89f8-2c81f16aa253 None None] MFA Rules not processed for user `a2cd623899b54b2186d7443ba69336f2`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:03.778049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b3923409-4d59-4c93-89f8-2c81f16aa253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:03.853988 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1350/2694] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:03 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:03.864125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:03.865821 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:03.934319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21abaf-4387-4d97-be25-b3d0b233f857 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:03.937828 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:03.938434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:03.938727 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:03.939016 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:04.005074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:04.006711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:04.016647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1345/2695] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:03 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:04.221029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923409-4d59-4c93-89f8-2c81f16aa253 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:04.298157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3923409-4d59-4c93-89f8-2c81f16aa253 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:04.304966 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:04.305798 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:04.306247 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:04.306828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:04.310301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:04.387833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:04.389473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:04.410711 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1351/2696] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:04 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:05.520512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:05.521886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:05.534011 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdfca2-24f5-4185-9d87-b36ac3b2a560 service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:05.537679 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:05.538257 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:05.538547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:05.538832 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:05.548367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:05.549776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:05.560976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1346/2697] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:05 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:09.065130 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:09.078037 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa994c3-d0b7-4776-81c8-73c37a0c5677 service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:09.084134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:09.084938 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:09.085409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:09.085861 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:09.087730 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:09.102514 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:09.104321 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:09.115082 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1352/2698] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:09 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:11.788861 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:11.858112 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b7bd7-0169-49ce-934c-4e86733cd40e service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:11.861947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:11.862549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:11.862912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:11.863127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:11.864910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:11.965897 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:11.967667 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:11.985510 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1347/2699] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:11 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:13.818324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:13.831112 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436599a6-61a7-4b5c-a3e3-a7f00c6ca446 service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:13.835202 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:13.836061 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:13.836448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:13.836829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:13.840630 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:13.900453 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:13.903346 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:13.926597 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10552f7-f94c-49c2-a53c-718ad8fa96f6 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:13.933899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:13.936106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:13.937319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:13.939560 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:13.939858 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:13.940896 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:13.947775 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:13.951089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1353/2700] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:13.968083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:13.969948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:13.981031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1348/2701] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:13 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 08 02:56:19.828035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:19.830548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:19.841892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe545b-ae92-4e41-bb30-450754c8f173 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:19.846011 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:19.846662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:19.846887 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:19.847180 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:19.849017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:19.861637 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:19.863057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:19.873006 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1354/2702] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:19.897561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:19.898968 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:19.912285 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1eb08-58b3-40ed-b1b5-f3ff9d7dce10 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:19.916580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:19.917653 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:19.918010 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:19.918304 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] PATH_INFO: `/v3/users/44a64fb1ebd9411eb6156c8ef97c3072` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:19.919411 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a64fb1ebd9411eb6156c8ef97c3072)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:19.921340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:19.969722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a64fb1ebd9411eb6156c8ef97c3072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:19.970308 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a64fb1ebd9411eb6156c8ef97c3072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:19.982818 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a64fb1ebd9411eb6156c8ef97c3072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:19.983470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a64fb1ebd9411eb6156c8ef97c3072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:19.991080 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-2f3da24d-5a3f-4427-ba71-7480d195a6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a64fb1ebd9411eb6156c8ef97c3072'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:20.003486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1349/2703] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:19 2022] DELETE /identity/v3/users/44a64fb1ebd9411eb6156c8ef97c3072 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:20.264552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:20.274218 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2313b3e-42c5-44e2-847a-12e50e16f3f1 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:20.345468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:20.346252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.346540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.346824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] PATH_INFO: `/v3/projects/ee869d0592334c418ed6cf2b4ba04ace` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.347913 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee869d0592334c418ed6cf2b4ba04ace)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:20.349819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:20.405785 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee869d0592334c418ed6cf2b4ba04ace', 'request_id': 'req-df004462-adc7-4f5c-b618-98b0a0fb285d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:20.414545 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee869d0592334c418ed6cf2b4ba04ace', 'request_id': 'req-df004462-adc7-4f5c-b618-98b0a0fb285d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:20.427455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee869d0592334c418ed6cf2b4ba04ace', 'request_id': 'req-df004462-adc7-4f5c-b618-98b0a0fb285d'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:20.438703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] The token cache is being invalidate because project ee869d0592334c418ed6cf2b4ba04ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:20.439559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:20.439802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-df004462-adc7-4f5c-b618-98b0a0fb285d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:20.441635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1355/2704] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:20 2022] DELETE /identity/v3/projects/ee869d0592334c418ed6cf2b4ba04ace => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:20.446761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f56215-5ab4-4200-b5fd-ca7d3b448000 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.447060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f56215-5ab4-4200-b5fd-ca7d3b448000 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.448317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f56215-5ab4-4200-b5fd-ca7d3b448000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.472149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-25f56215-5ab4-4200-b5fd-ca7d3b448000 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:20.473458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-25f56215-5ab4-4200-b5fd-ca7d3b448000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:20.563947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1350/2705] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:20.567104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7115-5fea-4e8d-93ac-cc88474e8187 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.567779 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7115-5fea-4e8d-93ac-cc88474e8187 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.568242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7115-5fea-4e8d-93ac-cc88474e8187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.592893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-37eb7115-5fea-4e8d-93ac-cc88474e8187 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:20.594088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-37eb7115-5fea-4e8d-93ac-cc88474e8187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:20.601605 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1356/2706] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:20.606963 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f56215-5ab4-4200-b5fd-ca7d3b448000 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:20.617019 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f56215-5ab4-4200-b5fd-ca7d3b448000 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:20.621873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:20.622546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.622931 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.623293 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.624102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:56:20.624475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:20.626136 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:20.640162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1351/2707] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:20.644230 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb7115-5fea-4e8d-93ac-cc88474e8187 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:20.654029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb7115-5fea-4e8d-93ac-cc88474e8187 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:20.658677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:20.659468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.662848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.662848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.662848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:20.662848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:20.697384 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1357/2708] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:20 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:20.702225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:20.712458 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568f0b-71a7-4c34-b235-54184f5575bb admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:20.801512 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:20.802292 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.802685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.803115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.803862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:20.806259 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:20.828454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1352/2709] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:20 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:20.832552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:20.843398 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e976e36-72da-4f71-b109-46beb93551d4 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:20.848571 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:20.849173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.849646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.849933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.850635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:20.852432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:20.863589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1358/2710] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:20.867638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:20.877359 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f4cda-c6e4-4c77-9475-4ea5d1dcd9cd admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:20.882051 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a425b47-1b02-4883-8a05-c6a5d7de1b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:20.882655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a425b47-1b02-4883-8a05-c6a5d7de1b8b admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.882951 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a425b47-1b02-4883-8a05-c6a5d7de1b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.883239 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a425b47-1b02-4883-8a05-c6a5d7de1b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.883959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a425b47-1b02-4883-8a05-c6a5d7de1b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:20.885626 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a425b47-1b02-4883-8a05-c6a5d7de1b8b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:20.896060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1353/2711] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:20.900313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:20.911278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad658-e5b0-4e01-96f1-c14a74ce6744 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:20.916333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:20.917765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.918224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.918670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] PATH_INFO: `/v3/projects/109f7c751d484faea6b324efcf6ff448/users/aef65d63b97b4acb9c76cdcf8cdbbb78/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:20.940991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109f7c751d484faea6b324efcf6ff448, user_id=aef65d63b97b4acb9c76cdcf8cdbbb78, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:20.943851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:20.960020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1359/2712] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:20 2022] PUT /identity/v3/projects/109f7c751d484faea6b324efcf6ff448/users/aef65d63b97b4acb9c76cdcf8cdbbb78/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:20.970868 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:20.971739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:20.972060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:21.013799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] MFA Rules not processed for user `aef65d63b97b4acb9c76cdcf8cdbbb78`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:21.015321 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:21.097476 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1354/2713] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:20 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:21.108737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:21.110521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:21.211596 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72c78-4949-4b20-9309-8156fa8f6ef0 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:21.223879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:21.224655 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:21.225054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:21.225444 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:21.234358 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:21.236485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:21.245946 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1360/2714] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:21 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:22.446600 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:22.450816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:22.532378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3ae52-bf05-4f51-ba82-ac0124d8cf5b None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:22.538933 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:22.540149 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:22.540447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:22.540736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] PATH_INFO: `/v3/users/7cfd085bd61d42c7a5963069b038a902` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:22.542613 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfd085bd61d42c7a5963069b038a902)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:22.544946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:22.603398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfd085bd61d42c7a5963069b038a902'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:22.604116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfd085bd61d42c7a5963069b038a902'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:22.617325 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfd085bd61d42c7a5963069b038a902'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:22.618064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfd085bd61d42c7a5963069b038a902'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:22.627439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfd085bd61d42c7a5963069b038a902'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:22.641934 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1355/2715] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:22 2022] DELETE /identity/v3/users/7cfd085bd61d42c7a5963069b038a902 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:22.879224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:22.890725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9934026-95b8-4203-82f8-ae9a6a93da90 service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:22.987543 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:22.988619 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:22.989105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:22.989552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] PATH_INFO: `/v3/projects/1b051a844bb34a5eb22cb95898cceb82` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:22.990847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b051a844bb34a5eb22cb95898cceb82)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:22.993608 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:23.071023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b051a844bb34a5eb22cb95898cceb82', 'request_id': 'req-91927cb4-8bff-4a22-882c-779535890770'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.081419 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b051a844bb34a5eb22cb95898cceb82', 'request_id': 'req-91927cb4-8bff-4a22-882c-779535890770'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.102404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b051a844bb34a5eb22cb95898cceb82', 'request_id': 'req-91927cb4-8bff-4a22-882c-779535890770'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.116264 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] The token cache is being invalidate because project 1b051a844bb34a5eb22cb95898cceb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:23.116864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.117688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.120297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1361/2716] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:22 2022] DELETE /identity/v3/projects/1b051a844bb34a5eb22cb95898cceb82 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:23.124334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:23.126484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:23.141567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb5ea-3454-42da-86f0-a95cafaa4e8c admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:23.248235 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:23.249221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:23.249619 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:23.250022 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] PATH_INFO: `/v3/users/a2cd623899b54b2186d7443ba69336f2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:23.251962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cd623899b54b2186d7443ba69336f2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:23.255199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:23.326918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cd623899b54b2186d7443ba69336f2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.327918 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cd623899b54b2186d7443ba69336f2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.345423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cd623899b54b2186d7443ba69336f2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.346291 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cd623899b54b2186d7443ba69336f2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.356988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-828d3c8d-1bc5-4267-a293-b820846a2bfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cd623899b54b2186d7443ba69336f2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.379457 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1356/2717] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:23 2022] DELETE /identity/v3/users/a2cd623899b54b2186d7443ba69336f2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:23.677018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:23.679502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:23.695427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91927cb4-8bff-4a22-882c-779535890770 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:23.778329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:23.779590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:23.780024 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:23.780555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] PATH_INFO: `/v3/projects/51b5139f0a4041cba2d752cde9633b65` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:23.782026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b5139f0a4041cba2d752cde9633b65)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:23.784868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:23.843584 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b5139f0a4041cba2d752cde9633b65', 'request_id': 'req-5173aa03-61fa-4303-8622-0c9dcf94d132'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.851871 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b5139f0a4041cba2d752cde9633b65', 'request_id': 'req-5173aa03-61fa-4303-8622-0c9dcf94d132'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.866516 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b5139f0a4041cba2d752cde9633b65', 'request_id': 'req-5173aa03-61fa-4303-8622-0c9dcf94d132'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.876197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] The token cache is being invalidate because project 51b5139f0a4041cba2d752cde9633b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:23.876486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.877140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-5173aa03-61fa-4303-8622-0c9dcf94d132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:23.879453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1362/2718] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:23 2022] DELETE /identity/v3/projects/51b5139f0a4041cba2d752cde9633b65 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:23.883454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407a5d-16d2-47ef-a99c-4b387af327fb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:23.883862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407a5d-16d2-47ef-a99c-4b387af327fb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:23.884076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407a5d-16d2-47ef-a99c-4b387af327fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:23.908471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1d407a5d-16d2-47ef-a99c-4b387af327fb None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:23.909744 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1d407a5d-16d2-47ef-a99c-4b387af327fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:23.978221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1357/2719] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:23.987067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85157a-79da-4543-8dbf-29bded855003 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:23.987373 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85157a-79da-4543-8dbf-29bded855003 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:23.987662 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85157a-79da-4543-8dbf-29bded855003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.010114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8e85157a-79da-4543-8dbf-29bded855003 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:24.011462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8e85157a-79da-4543-8dbf-29bded855003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:24.019990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1363/2720] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:24.024356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407a5d-16d2-47ef-a99c-4b387af327fb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.035436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407a5d-16d2-47ef-a99c-4b387af327fb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.040263 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.040891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.041283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.041611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.042311 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:56:24.042655 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.044227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:24.058050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1358/2721] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:56:24.062482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85157a-79da-4543-8dbf-29bded855003 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.071636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85157a-79da-4543-8dbf-29bded855003 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.076530 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.077117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.077411 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.077700 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.078339 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.080338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:24.111997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1364/2722] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:24 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:24.113548 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.123647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05ead-ccbc-4f68-a585-88e8fba208a5 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.187489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.188147 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.188447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.188739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.189496 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.191556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:24.213387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1359/2723] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:24 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:24.217907 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.228792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecc86f-4970-4f21-baac-ce62fd224c14 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.234270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.234887 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.235206 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.235494 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.236240 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.237868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:24.249258 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1365/2724] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:24.253554 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.263880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694936d-35a8-42ad-9a78-747dfbe44855 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.268436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b681a-a0ca-492c-9189-eadfcd256968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.269034 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b681a-a0ca-492c-9189-eadfcd256968 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.269328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b681a-a0ca-492c-9189-eadfcd256968 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.269617 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b681a-a0ca-492c-9189-eadfcd256968 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.270327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b681a-a0ca-492c-9189-eadfcd256968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.271916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b681a-a0ca-492c-9189-eadfcd256968 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:24.282404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1360/2725] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:24.286692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.297573 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35aca3-3ad2-415e-b291-21583f24cb56 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.309554 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.310680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.311038 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.311559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] PATH_INFO: `/v3/projects/9e2629ed0483482588959ec1e5f818af/users/4c73a12c1b6749b3882b510aef5cabe3/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.333083 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2629ed0483482588959ec1e5f818af, user_id=4c73a12c1b6749b3882b510aef5cabe3, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.335895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:24.351057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1366/2726] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:24 2022] PUT /identity/v3/projects/9e2629ed0483482588959ec1e5f818af/users/4c73a12c1b6749b3882b510aef5cabe3/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:24.356578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb5ef-e8b2-444e-ac4a-646b574bc8a7 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.356879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb5ef-e8b2-444e-ac4a-646b574bc8a7 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.357187 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cb5ef-e8b2-444e-ac4a-646b574bc8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.379504 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-242cb5ef-e8b2-444e-ac4a-646b574bc8a7 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:24.380719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-242cb5ef-e8b2-444e-ac4a-646b574bc8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:24.477647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1361/2727] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:24.488787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:24.490862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:24.649304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e30723-0d17-4e29-99a2-0f4c17491f4a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:24.657893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:24.658666 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:24.658961 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:24.659255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:24.671583 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:24.673197 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:24.684522 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1367/2728] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:25.619002 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958e79c-917f-4087-914b-8f843acc3ed3 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.620006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958e79c-917f-4087-914b-8f843acc3ed3 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.620570 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958e79c-917f-4087-914b-8f843acc3ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.661353 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e958e79c-917f-4087-914b-8f843acc3ed3 None None] MFA Rules not processed for user `4c73a12c1b6749b3882b510aef5cabe3`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:25.662768 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e958e79c-917f-4087-914b-8f843acc3ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:25.770083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1362/2729] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:25 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:25.781350 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:25.783353 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:25.864852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0192abe-bde3-4ed2-9844-fb714ef4a71a service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:25.869272 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3056a3-fed7-43b4-a164-7fab6f33e613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:25.870628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3056a3-fed7-43b4-a164-7fab6f33e613 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:25.871003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3056a3-fed7-43b4-a164-7fab6f33e613 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:25.871404 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3056a3-fed7-43b4-a164-7fab6f33e613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:25.883030 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3056a3-fed7-43b4-a164-7fab6f33e613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:25.885747 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3056a3-fed7-43b4-a164-7fab6f33e613 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:25.895481 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1368/2730] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:25 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:28.568195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958e79c-917f-4087-914b-8f843acc3ed3 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:28.580739 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958e79c-917f-4087-914b-8f843acc3ed3 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:28.585436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:28.585994 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.586486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.587191 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.590589 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:28.623166 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:28.623725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:28.623725 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:28.646216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] MFA Rules not processed for user `4c73a12c1b6749b3882b510aef5cabe3`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:28.647590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:28.655013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1369/2731] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:28.697471 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:28.699436 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:28.710949 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1363/2732] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:28 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:31.292511 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:31.293924 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:31.307863 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509a5a6-c134-4864-9d34-aebab5cadf61 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:31.312236 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:31.313035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:31.313327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:31.313609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] PATH_INFO: `/v3/users/a0f675843ecb4ef2b4c1b450b6bacf88` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:31.314713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f675843ecb4ef2b4c1b450b6bacf88)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:31.316669 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:31.366078 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f675843ecb4ef2b4c1b450b6bacf88'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.374668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f675843ecb4ef2b4c1b450b6bacf88'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.375468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f675843ecb4ef2b4c1b450b6bacf88'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.376119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f675843ecb4ef2b4c1b450b6bacf88'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.387825 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-80e95c63-b22e-46f7-9904-8c5b43bccab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f675843ecb4ef2b4c1b450b6bacf88'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.404496 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1370/2733] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:31 2022] DELETE /identity/v3/users/a0f675843ecb4ef2b4c1b450b6bacf88 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:31.641312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:31.643234 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:31.656940 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186b24d-b285-4fe7-8f3b-a3b15bca7c70 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:31.723521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:31.724358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:31.724649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:31.724933 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] PATH_INFO: `/v3/users/aef65d63b97b4acb9c76cdcf8cdbbb78` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:31.726026 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef65d63b97b4acb9c76cdcf8cdbbb78)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:31.727959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:31.779905 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef65d63b97b4acb9c76cdcf8cdbbb78'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.780587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef65d63b97b4acb9c76cdcf8cdbbb78'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.792584 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef65d63b97b4acb9c76cdcf8cdbbb78'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.793254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef65d63b97b4acb9c76cdcf8cdbbb78'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.800844 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef65d63b97b4acb9c76cdcf8cdbbb78'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:31.814573 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1364/2734] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:31 2022] DELETE /identity/v3/users/aef65d63b97b4acb9c76cdcf8cdbbb78 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:31.819054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:31.819352 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:31.819639 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:31.842790 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:31.844172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:31.917277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1371/2735] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:31.925189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:31.926701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:31.998736 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae1978-adf9-44de-b01c-32b097979f31 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.002366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.002972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.003249 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.003534 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.012691 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.014130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:32.023686 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1365/2736] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:32.357162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.358758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.372802 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5917a-a67c-4afd-9308-92e8edddd0ac None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.379163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.380287 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.381141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.381964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] PATH_INFO: `/v3/projects/0f7f360a7ebf4464b91dce9442330898` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.386952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.388602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.393705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7f360a7ebf4464b91dce9442330898)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.395659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:32.402087 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec44d9-f732-4dd1-a8dd-ab2340070cd1 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.409842 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.410976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.411361 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.411723 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] PATH_INFO: `/v3/projects/109f7c751d484faea6b324efcf6ff448` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.412958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=109f7c751d484faea6b324efcf6ff448)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.415044 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:32.457749 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7f360a7ebf4464b91dce9442330898', 'request_id': 'req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.467277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7f360a7ebf4464b91dce9442330898', 'request_id': 'req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.481395 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7f360a7ebf4464b91dce9442330898', 'request_id': 'req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.492325 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] The token cache is being invalidate because project 0f7f360a7ebf4464b91dce9442330898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:32.492840 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.493678 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.494031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109f7c751d484faea6b324efcf6ff448', 'request_id': 'req-502377ea-5170-4495-b300-e1f38fd05578'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.496804 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1372/2737] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:32 2022] DELETE /identity/v3/projects/0f7f360a7ebf4464b91dce9442330898 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:32.500533 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.501546 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109f7c751d484faea6b324efcf6ff448', 'request_id': 'req-502377ea-5170-4495-b300-e1f38fd05578'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.502200 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.511473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109f7c751d484faea6b324efcf6ff448', 'request_id': 'req-502377ea-5170-4495-b300-e1f38fd05578'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.533095 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] The token cache is being invalidate because project 109f7c751d484faea6b324efcf6ff448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:32.533403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.534133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-502377ea-5170-4495-b300-e1f38fd05578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.540278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1366/2738] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:32 2022] DELETE /identity/v3/projects/109f7c751d484faea6b324efcf6ff448 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:32.545277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a67a8-bce4-4c39-9030-8dbbd648c7fc None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.545819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a67a8-bce4-4c39-9030-8dbbd648c7fc None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.546130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a67a8-bce4-4c39-9030-8dbbd648c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.571984 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-1e1a67a8-bce4-4c39-9030-8dbbd648c7fc None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:32.573266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-1e1a67a8-bce4-4c39-9030-8dbbd648c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.596788 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0790f3c-dc8c-4406-bf19-af86e9b2dd77 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.654020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1367/2739] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:32.658162 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21e0c5-5a8a-41b8-8aec-95cdec9e9131 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.658470 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21e0c5-5a8a-41b8-8aec-95cdec9e9131 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.658894 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21e0c5-5a8a-41b8-8aec-95cdec9e9131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.672018 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.672866 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.673163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.673455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] PATH_INFO: `/v3/users/9cf5779719404a6e8cda672a7d55a71e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.674602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf5779719404a6e8cda672a7d55a71e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.676659 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:32.683519 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-0c21e0c5-5a8a-41b8-8aec-95cdec9e9131 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:32.684732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-0c21e0c5-5a8a-41b8-8aec-95cdec9e9131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.692208 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1368/2740] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:32.696354 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21e0c5-5a8a-41b8-8aec-95cdec9e9131 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.705203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21e0c5-5a8a-41b8-8aec-95cdec9e9131 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.710029 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.710625 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.710916 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.711391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.712416 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:56:32.712915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.714547 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:32.732915 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1369/2741] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:32.734118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.734674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf5779719404a6e8cda672a7d55a71e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.743611 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf5779719404a6e8cda672a7d55a71e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.744590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf5779719404a6e8cda672a7d55a71e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.745344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf5779719404a6e8cda672a7d55a71e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.745469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e38b-dedd-4bd1-b41f-00c2e4135b49 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.750439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.750926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.751434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.751726 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.752434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.754335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:32.761777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf5779719404a6e8cda672a7d55a71e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:32.777274 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1373/2742] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:32 2022] DELETE /identity/v3/users/9cf5779719404a6e8cda672a7d55a71e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:32.787670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1370/2743] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:32.792000 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.793744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:32.874824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da741d8-1e2f-4256-8028-28dd9bfb327f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.943857 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.944746 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.944887 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.945217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.945870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.947902 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:32.970979 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1374/2744] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:32 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:32.975226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:32.986533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6cb54-d649-4fae-a536-3c2e21ecb7d3 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:32.991911 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:32.992654 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:32.993050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:32.993439 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:32.994283 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:32.996166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:33.009531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1371/2745] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:33.010942 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.025025 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.027399 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:33.029576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad6d9d-104d-4654-8682-f1c449c494ca admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.034862 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.035849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.036400 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.036953 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.037898 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.040095 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:33.041975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04115-f550-4f42-b478-7161dadd7574 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.046581 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.047387 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.047675 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.047995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] PATH_INFO: `/v3/projects/e652bfd4bd0340bb99d09621eaade62b` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.049125 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e652bfd4bd0340bb99d09621eaade62b)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.051024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:33.052365 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1375/2746] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:33.056135 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.066556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35072806-f9d3-4fc7-b314-47c682129ffb admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.071985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365a18c-d1aa-42a2-ac5c-d48ebd4e216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.073416 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365a18c-d1aa-42a2-ac5c-d48ebd4e216f admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.074216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365a18c-d1aa-42a2-ac5c-d48ebd4e216f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.074870 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365a18c-d1aa-42a2-ac5c-d48ebd4e216f admin admin] PATH_INFO: `/v3/projects/88a7e8d688c3446bb7a4a02600939687/users/f6487739de7b49e89e27563a0ea91a8a/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.100011 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365a18c-d1aa-42a2-ac5c-d48ebd4e216f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a7e8d688c3446bb7a4a02600939687, user_id=f6487739de7b49e89e27563a0ea91a8a, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.103300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365a18c-d1aa-42a2-ac5c-d48ebd4e216f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:33.108565 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e652bfd4bd0340bb99d09621eaade62b', 'request_id': 'req-232ea854-40e0-4dee-b7f8-a1af4ec6594e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:33.114373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e652bfd4bd0340bb99d09621eaade62b', 'request_id': 'req-232ea854-40e0-4dee-b7f8-a1af4ec6594e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:33.119041 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1376/2747] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:33 2022] PUT /identity/v3/projects/88a7e8d688c3446bb7a4a02600939687/users/f6487739de7b49e89e27563a0ea91a8a/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:33.126922 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e652bfd4bd0340bb99d09621eaade62b', 'request_id': 'req-232ea854-40e0-4dee-b7f8-a1af4ec6594e'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:33.130440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d567309-e06e-4a7a-81b1-de5143e87242 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.130814 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d567309-e06e-4a7a-81b1-de5143e87242 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.131204 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d567309-e06e-4a7a-81b1-de5143e87242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.145154 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] The token cache is being invalidate because project e652bfd4bd0340bb99d09621eaade62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:33.145452 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:33.146118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:33.147805 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1372/2748] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:33 2022] DELETE /identity/v3/projects/e652bfd4bd0340bb99d09621eaade62b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:33.172632 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-0d567309-e06e-4a7a-81b1-de5143e87242 None None] MFA Rules not processed for user `f6487739de7b49e89e27563a0ea91a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:33.174238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0d567309-e06e-4a7a-81b1-de5143e87242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:33.280224 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1377/2749] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:33.282192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.286286 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:33.397344 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea854-40e0-4dee-b7f8-a1af4ec6594e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.483165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.484040 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.484435 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.484863 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.485621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.494078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:33.549270 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1373/2750] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:33 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:33.553813 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d567309-e06e-4a7a-81b1-de5143e87242 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.572429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d567309-e06e-4a7a-81b1-de5143e87242 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.846242 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.847042 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.847439 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.847829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.848839 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.851473 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:33.888895 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1378/2751] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:33 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:33.892835 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.905838 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eaeab-f558-45e8-b799-edf784d6a0f1 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.912972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.928698 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.928698 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.929180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:33.930020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:33.931806 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:33.954086 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1374/2752] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:33.957031 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:33.973393 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acd1a5-d0a7-4dad-a6b8-16e29afdfe6a admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:33.981663 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:33.982759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:33.983238 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:33.983796 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] PATH_INFO: `/v3/projects/852cc031e4384dbf980192f7067c9063/users/eb243f44c0594958a15ff41fe1e492e2/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.014699 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852cc031e4384dbf980192f7067c9063, user_id=eb243f44c0594958a15ff41fe1e492e2, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.019104 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:34.044066 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1379/2753] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:33 2022] PUT /identity/v3/projects/852cc031e4384dbf980192f7067c9063/users/eb243f44c0594958a15ff41fe1e492e2/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:34.044933 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:34.065485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38265ae-9024-4e45-aa0c-caa0ac60b12d admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:34.207199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398379be-77c8-4057-a243-4b8cfa9a7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:34.208673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398379be-77c8-4057-a243-4b8cfa9a7894 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.209127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398379be-77c8-4057-a243-4b8cfa9a7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.209673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398379be-77c8-4057-a243-4b8cfa9a7894 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.210770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398379be-77c8-4057-a243-4b8cfa9a7894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.213856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398379be-77c8-4057-a243-4b8cfa9a7894 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:34.232784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:34.252169 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1375/2754] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:34.253564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80622b-c65d-40ed-88b6-b42422ef9508 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:34.258634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:34.259703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.260628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.260967 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] PATH_INFO: `/v3/projects/852cc031e4384dbf980192f7067c9063/users/eb243f44c0594958a15ff41fe1e492e2/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.263985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852cc031e4384dbf980192f7067c9063, user_id=eb243f44c0594958a15ff41fe1e492e2, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.266521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:34.299303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1380/2755] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:34 2022] PUT /identity/v3/projects/852cc031e4384dbf980192f7067c9063/users/eb243f44c0594958a15ff41fe1e492e2/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:34.301358 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b4f5-a83c-4fa1-bb39-7406cad95e74 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.301664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b4f5-a83c-4fa1-bb39-7406cad95e74 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.301959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b4f5-a83c-4fa1-bb39-7406cad95e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.356372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-6e87b4f5-a83c-4fa1-bb39-7406cad95e74 None None] MFA Rules not processed for user `eb243f44c0594958a15ff41fe1e492e2`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:34.357906 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6e87b4f5-a83c-4fa1-bb39-7406cad95e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:34.577890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1376/2756] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:34.584214 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:34.586538 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:34.704642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6556bbd-aae0-4145-b3e8-c59f390b1051 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:34.709521 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c819dc-afd7-4ddd-baf1-d6f5411b97ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:34.710117 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c819dc-afd7-4ddd-baf1-d6f5411b97ae service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:34.710703 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c819dc-afd7-4ddd-baf1-d6f5411b97ae service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:34.711003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c819dc-afd7-4ddd-baf1-d6f5411b97ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:34.785035 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c819dc-afd7-4ddd-baf1-d6f5411b97ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:34.786777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c819dc-afd7-4ddd-baf1-d6f5411b97ae service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:34.798271 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1381/2757] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:34 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:37.726213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87b4f5-a83c-4fa1-bb39-7406cad95e74 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:37.809855 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87b4f5-a83c-4fa1-bb39-7406cad95e74 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:37.815181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:37.816153 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.816509 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.816860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] PATH_INFO: `/v3/users/f6487739de7b49e89e27563a0ea91a8a` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.818110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6487739de7b49e89e27563a0ea91a8a)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:37.821038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:37.891962 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6487739de7b49e89e27563a0ea91a8a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:37.892989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6487739de7b49e89e27563a0ea91a8a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:37.905605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6487739de7b49e89e27563a0ea91a8a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:37.906227 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6487739de7b49e89e27563a0ea91a8a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:37.913748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6487739de7b49e89e27563a0ea91a8a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:37.926206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1377/2758] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:37 2022] DELETE /identity/v3/users/f6487739de7b49e89e27563a0ea91a8a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:37.930470 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:37.930964 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:37.931057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:37.953931 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:37.955118 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:38.025107 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1382/2759] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:38.035647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:38.037203 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:38.103761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0038669-4346-4dad-b60c-d618e0ac0c83 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:38.107582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:38.108207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:38.108502 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:38.108854 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:38.118049 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:38.120426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:38.140485 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1378/2760] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:38.561546 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:38.563430 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:38.579875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062d792-9401-468c-ba92-95d5a3617373 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:38.584449 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:38.585243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:38.585563 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:38.585845 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] PATH_INFO: `/v3/projects/88a7e8d688c3446bb7a4a02600939687` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:38.586956 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a7e8d688c3446bb7a4a02600939687)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:38.590157 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:38.640007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a7e8d688c3446bb7a4a02600939687', 'request_id': 'req-1702a965-b10b-4ceb-9ff5-46c1a866ae21'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.647047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a7e8d688c3446bb7a4a02600939687', 'request_id': 'req-1702a965-b10b-4ceb-9ff5-46c1a866ae21'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.658828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a7e8d688c3446bb7a4a02600939687', 'request_id': 'req-1702a965-b10b-4ceb-9ff5-46c1a866ae21'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.668879 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] The token cache is being invalidate because project 88a7e8d688c3446bb7a4a02600939687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:38.669172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.669833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.671298 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1383/2761] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:38 2022] DELETE /identity/v3/projects/88a7e8d688c3446bb7a4a02600939687 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:38.675345 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:38.685090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affff62b-d108-42b3-a572-b7e2f595d3ee service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:38.749372 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:38.750181 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:38.750472 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:38.750757 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] PATH_INFO: `/v3/users/eb243f44c0594958a15ff41fe1e492e2` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:38.751848 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb243f44c0594958a15ff41fe1e492e2)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:38.753765 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:38.810927 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb243f44c0594958a15ff41fe1e492e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.811569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb243f44c0594958a15ff41fe1e492e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.823697 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb243f44c0594958a15ff41fe1e492e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.824582 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb243f44c0594958a15ff41fe1e492e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.836607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-358f10f5-6806-4770-aaff-653a6c5ac1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb243f44c0594958a15ff41fe1e492e2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:38.852645 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1379/2762] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:38 2022] DELETE /identity/v3/users/eb243f44c0594958a15ff41fe1e492e2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:39.228142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.230733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:39.247013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702a965-b10b-4ceb-9ff5-46c1a866ae21 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.319432 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.320487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.320774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.321062 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] PATH_INFO: `/v3/projects/852cc031e4384dbf980192f7067c9063` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.322781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852cc031e4384dbf980192f7067c9063)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.325367 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:39.380531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852cc031e4384dbf980192f7067c9063', 'request_id': 'req-a8c589fb-dde0-48db-966b-b9a555366759'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.388207 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852cc031e4384dbf980192f7067c9063', 'request_id': 'req-a8c589fb-dde0-48db-966b-b9a555366759'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.400383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852cc031e4384dbf980192f7067c9063', 'request_id': 'req-a8c589fb-dde0-48db-966b-b9a555366759'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.412301 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] The token cache is being invalidate because project 852cc031e4384dbf980192f7067c9063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:39.413084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.414091 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-a8c589fb-dde0-48db-966b-b9a555366759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:39.415762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1384/2763] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:39 2022] DELETE /identity/v3/projects/852cc031e4384dbf980192f7067c9063 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:39.422195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1933c-cf9e-4a6e-92d1-78ba7723b648 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.422641 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1933c-cf9e-4a6e-92d1-78ba7723b648 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.423065 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1933c-cf9e-4a6e-92d1-78ba7723b648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.446932 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f2d1933c-cf9e-4a6e-92d1-78ba7723b648 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:39.448503 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f2d1933c-cf9e-4a6e-92d1-78ba7723b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:39.529975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1380/2764] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:39.538690 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d5915-37d0-4eb2-8796-98dc19331b98 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.538990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d5915-37d0-4eb2-8796-98dc19331b98 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.539277 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d5915-37d0-4eb2-8796-98dc19331b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.565993 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1d1d5915-37d0-4eb2-8796-98dc19331b98 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:39.567173 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1d1d5915-37d0-4eb2-8796-98dc19331b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:39.576172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1385/2765] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:39.581233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1933c-cf9e-4a6e-92d1-78ba7723b648 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.592770 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1933c-cf9e-4a6e-92d1-78ba7723b648 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.598184 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.598819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.599109 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.599396 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.600127 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:56:39.600912 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.602186 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:39.617461 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1381/2766] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:39.623149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d5915-37d0-4eb2-8796-98dc19331b98 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.633391 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d5915-37d0-4eb2-8796-98dc19331b98 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.639102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.639695 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.640013 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.640300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.641134 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.643338 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:39.673627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1386/2767] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:39 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:39.678670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.689748 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d7e7-eb70-4ba8-b45a-10f1cc7ca7e7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.758745 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.759381 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.759556 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.759903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.761073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.762995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:39.782521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1382/2768] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:39 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:39.786572 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.796744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7379cb3-754f-400f-ac17-05b65392fb9d admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.801119 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.801710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.802005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.802295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.802990 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.804623 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:39.817282 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1387/2769] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:39.821490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.831614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038ef7e-9a8a-43b7-b7fd-1e6de994c6df admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.836207 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320efad9-12ac-4a63-bf70-d59b8c8056fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.836819 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320efad9-12ac-4a63-bf70-d59b8c8056fe admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.837111 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320efad9-12ac-4a63-bf70-d59b8c8056fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.837397 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320efad9-12ac-4a63-bf70-d59b8c8056fe admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.838566 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320efad9-12ac-4a63-bf70-d59b8c8056fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.840197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320efad9-12ac-4a63-bf70-d59b8c8056fe admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:39.850083 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1383/2770] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:39.854070 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:39.868497 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb06419-d113-45a3-a98e-58255b42b898 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:39.873783 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:39.874586 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.874875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.875159 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] PATH_INFO: `/v3/projects/eaf33eaf193a43b19d4189235739889b/users/d564e64fc3564c5997675584b45ac3e4/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.894610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf33eaf193a43b19d4189235739889b, user_id=d564e64fc3564c5997675584b45ac3e4, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:39.897279 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:39.909591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1388/2771] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:39 2022] PUT /identity/v3/projects/eaf33eaf193a43b19d4189235739889b/users/d564e64fc3564c5997675584b45ac3e4/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:39.920352 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54e42-b8cf-437d-ac54-af111d406105 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:39.920684 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54e42-b8cf-437d-ac54-af111d406105 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:39.920975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab54e42-b8cf-437d-ac54-af111d406105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:39.956640 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-7ab54e42-b8cf-437d-ac54-af111d406105 None None] MFA Rules not processed for user `d564e64fc3564c5997675584b45ac3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:39.957798 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-7ab54e42-b8cf-437d-ac54-af111d406105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.033694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1384/2772] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:40.044847 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.046552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.111370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64812a-a368-41f7-a7ce-234f7e895051 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.114832 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e105ee-7454-4c89-b393-a2fd80dee2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.115414 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e105ee-7454-4c89-b393-a2fd80dee2cd service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.115705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e105ee-7454-4c89-b393-a2fd80dee2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.116029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e105ee-7454-4c89-b393-a2fd80dee2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.125014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e105ee-7454-4c89-b393-a2fd80dee2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.126457 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e105ee-7454-4c89-b393-a2fd80dee2cd service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:40.135585 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1389/2773] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:40 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:40.158150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab54e42-b8cf-437d-ac54-af111d406105 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.227669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab54e42-b8cf-437d-ac54-af111d406105 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.232953 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.233746 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.234035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.234319 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] PATH_INFO: `/v3/users/d564e64fc3564c5997675584b45ac3e4` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.235423 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d564e64fc3564c5997675584b45ac3e4)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.237340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:40.285272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd564e64fc3564c5997675584b45ac3e4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.285829 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd564e64fc3564c5997675584b45ac3e4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.298313 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd564e64fc3564c5997675584b45ac3e4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.298969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd564e64fc3564c5997675584b45ac3e4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.306317 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd564e64fc3564c5997675584b45ac3e4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:40.318430 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1385/2774] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:40 2022] DELETE /identity/v3/users/d564e64fc3564c5997675584b45ac3e4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:40.322758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.323234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.323341 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.345478 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:40.346692 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.411407 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1390/2775] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:40.423454 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.424830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.492952 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b99642-14d4-4902-8cc0-554b9b60b875 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.497447 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4cb55-41c2-4cb6-85a7-07336a61f4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.498266 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4cb55-41c2-4cb6-85a7-07336a61f4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.498608 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4cb55-41c2-4cb6-85a7-07336a61f4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.498958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4cb55-41c2-4cb6-85a7-07336a61f4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.509240 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4cb55-41c2-4cb6-85a7-07336a61f4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.510776 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4cb55-41c2-4cb6-85a7-07336a61f4d1 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:40.520827 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1386/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:40.954427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:40.955778 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:40.967574 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cacf08-cfd0-4a73-940b-6f15347627cc None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:40.971808 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:40.972613 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:40.972899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:40.973179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] PATH_INFO: `/v3/projects/eaf33eaf193a43b19d4189235739889b` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:40.974262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf33eaf193a43b19d4189235739889b)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:40.976227 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.025014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf33eaf193a43b19d4189235739889b', 'request_id': 'req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:41.031864 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf33eaf193a43b19d4189235739889b', 'request_id': 'req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:41.042821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf33eaf193a43b19d4189235739889b', 'request_id': 'req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:41.052773 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] The token cache is being invalidate because project eaf33eaf193a43b19d4189235739889b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:41.053054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:41.053661 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-03e29b2c-4ab9-4d32-882e-a391e3ef5d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:41.055081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1391/2777] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:40 2022] DELETE /identity/v3/projects/eaf33eaf193a43b19d4189235739889b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:41.060628 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda5a08-2861-443f-91b5-b3bb78cd67eb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.061167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda5a08-2861-443f-91b5-b3bb78cd67eb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.061267 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda5a08-2861-443f-91b5-b3bb78cd67eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.083166 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-ecda5a08-2861-443f-91b5-b3bb78cd67eb None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:41.084340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-ecda5a08-2861-443f-91b5-b3bb78cd67eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:41.149068 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1387/2778] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:56:41.156852 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6d63-ef79-4043-a7ed-e8268e5ab821 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.157172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6d63-ef79-4043-a7ed-e8268e5ab821 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.157454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb6d63-ef79-4043-a7ed-e8268e5ab821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.179055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-bfeb6d63-ef79-4043-a7ed-e8268e5ab821 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:41.180221 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bfeb6d63-ef79-4043-a7ed-e8268e5ab821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:41.188370 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1392/2779] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:41.192506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda5a08-2861-443f-91b5-b3bb78cd67eb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.202978 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda5a08-2861-443f-91b5-b3bb78cd67eb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.207299 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.207879 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.208199 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.208484 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.209175 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:56:41.209478 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.211039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.223110 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1388/2780] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 08 02:56:41.227252 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6d63-ef79-4043-a7ed-e8268e5ab821 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.236084 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb6d63-ef79-4043-a7ed-e8268e5ab821 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.240469 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.241046 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.241333 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.241616 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.242250 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.244833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.271627 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1393/2781] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:56:41.275711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.285275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e46858-edcb-4534-825d-80616a42238a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.348107 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.348720 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.349013 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.349307 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.349955 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.351864 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.373557 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1389/2782] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:41.376960 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.387667 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2319dc2-5549-4811-9b49-2dd51109ec52 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.392454 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.393081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.393509 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.393685 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.394448 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.396427 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.408456 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1394/2783] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:41.412648 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.422412 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4080b-761e-41ff-a617-613c46848d15 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.426988 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920229db-919b-4a72-a3d2-5bb96d3cead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.427669 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920229db-919b-4a72-a3d2-5bb96d3cead9 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.428076 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920229db-919b-4a72-a3d2-5bb96d3cead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.428369 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920229db-919b-4a72-a3d2-5bb96d3cead9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.429079 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920229db-919b-4a72-a3d2-5bb96d3cead9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.430672 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920229db-919b-4a72-a3d2-5bb96d3cead9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.443967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1390/2784] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:56:41.448422 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.458589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76caec3-0846-401b-afaa-d6a62e7741b2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.463799 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.464677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.465081 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.465383 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] PATH_INFO: `/v3/projects/dfcd86272fd44c8fbd6985a15425d9a0/users/5338873e6006456ab77846592c2a1a63/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.489430 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfcd86272fd44c8fbd6985a15425d9a0, user_id=5338873e6006456ab77846592c2a1a63, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.492092 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.508019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1395/2785] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:41 2022] PUT /identity/v3/projects/dfcd86272fd44c8fbd6985a15425d9a0/users/5338873e6006456ab77846592c2a1a63/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:41.519315 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76fc21-9d79-4f4d-afce-bd443d0f9a2e None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.519633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76fc21-9d79-4f4d-afce-bd443d0f9a2e None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.519917 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76fc21-9d79-4f4d-afce-bd443d0f9a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.558281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-fe76fc21-9d79-4f4d-afce-bd443d0f9a2e None None] MFA Rules not processed for user `5338873e6006456ab77846592c2a1a63`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:41.559824 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-fe76fc21-9d79-4f4d-afce-bd443d0f9a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:41.643269 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1391/2786] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:41 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:41.653229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:41.655344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:41.721972 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccee433-fe1e-4215-8793-3ee7344c443c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:41.726316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:41.727337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:41.727337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:41.727758 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:41.737564 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:41.739131 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:41.748577 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1396/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:41 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:48.919860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042a9ce-6646-4e13-bc1e-379a0cfc1d57 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:48.920395 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042a9ce-6646-4e13-bc1e-379a0cfc1d57 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:48.920714 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042a9ce-6646-4e13-bc1e-379a0cfc1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:48.945497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-9042a9ce-6646-4e13-bc1e-379a0cfc1d57 None None] MFA Rules not processed for user `4c73a12c1b6749b3882b510aef5cabe3`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:48.946647 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-9042a9ce-6646-4e13-bc1e-379a0cfc1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:49.006198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1392/2788] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:49.309446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:49.310767 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:49.374276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd8f09-442c-43a5-a74e-2a7f3debb7ef service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:49.377756 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b12382-edb7-4791-9b43-828268cdd277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:49.378331 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12382-edb7-4791-9b43-828268cdd277 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:49.378620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12382-edb7-4791-9b43-828268cdd277 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:49.378901 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b12382-edb7-4791-9b43-828268cdd277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:49.380604 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-11b12382-edb7-4791-9b43-828268cdd277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:49.390933 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b12382-edb7-4791-9b43-828268cdd277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:49.392506 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b12382-edb7-4791-9b43-828268cdd277 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:49.400821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1397/2789] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:52.448761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042a9ce-6646-4e13-bc1e-379a0cfc1d57 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:52.521193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042a9ce-6646-4e13-bc1e-379a0cfc1d57 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:52.525958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:52.526760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:52.527053 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:52.527339 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] PATH_INFO: `/v3/users/5338873e6006456ab77846592c2a1a63` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:52.528490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5338873e6006456ab77846592c2a1a63)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:52.530442 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:52.583460 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5338873e6006456ab77846592c2a1a63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:52.584180 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5338873e6006456ab77846592c2a1a63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:52.595781 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5338873e6006456ab77846592c2a1a63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:52.596545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5338873e6006456ab77846592c2a1a63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:52.604467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5338873e6006456ab77846592c2a1a63'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:52.617148 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1393/2790] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:56:52 2022] DELETE /identity/v3/users/5338873e6006456ab77846592c2a1a63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:56:52.622178 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:52.622989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:52.622989 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:52.644458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:52.645633 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:52.712085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1398/2791] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:52.723256 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:52.724677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:52.794614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aff1f8-0878-4755-977d-d9b460d89308 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:52.798198 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563febf2-3235-4984-a917-df0e8d220322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:52.798817 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563febf2-3235-4984-a917-df0e8d220322 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:52.799195 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563febf2-3235-4984-a917-df0e8d220322 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:52.799486 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563febf2-3235-4984-a917-df0e8d220322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:52.809973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563febf2-3235-4984-a917-df0e8d220322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:52.811437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563febf2-3235-4984-a917-df0e8d220322 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:52.820611 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1394/2792] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:56:53.463193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:53.468642 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:53.480217 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055626a5-ea0d-436b-b3dc-6108d15c40b6 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:53.493172 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:53.494229 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:53.494600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:53.495025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] PATH_INFO: `/v3/projects/dfcd86272fd44c8fbd6985a15425d9a0` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:53.496559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfcd86272fd44c8fbd6985a15425d9a0)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:53.499717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:53.585698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfcd86272fd44c8fbd6985a15425d9a0', 'request_id': 'req-75e5fb05-ac0c-47ae-8d91-b7873aaab899'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:53.594824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfcd86272fd44c8fbd6985a15425d9a0', 'request_id': 'req-75e5fb05-ac0c-47ae-8d91-b7873aaab899'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:53.611387 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfcd86272fd44c8fbd6985a15425d9a0', 'request_id': 'req-75e5fb05-ac0c-47ae-8d91-b7873aaab899'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:53.622076 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] The token cache is being invalidate because project dfcd86272fd44c8fbd6985a15425d9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:56:53.622468 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:53.623149 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-75e5fb05-ac0c-47ae-8d91-b7873aaab899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:56:53.624679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1399/2793] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:56:53 2022] DELETE /identity/v3/projects/dfcd86272fd44c8fbd6985a15425d9a0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:53.632734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3c51-71ca-4e60-81e8-d05236f739fd None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:53.632734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3c51-71ca-4e60-81e8-d05236f739fd None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:53.632734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3c51-71ca-4e60-81e8-d05236f739fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:53.663414 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-eb2e3c51-71ca-4e60-81e8-d05236f739fd None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:53.664908 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-eb2e3c51-71ca-4e60-81e8-d05236f739fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:53.742278 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1395/2794] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:53.752435 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1328b7-7766-4016-b23d-cecdac16d6bb None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:53.752734 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1328b7-7766-4016-b23d-cecdac16d6bb None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:53.753023 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1328b7-7766-4016-b23d-cecdac16d6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:53.777267 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-1f1328b7-7766-4016-b23d-cecdac16d6bb None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:53.778466 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-1f1328b7-7766-4016-b23d-cecdac16d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:53.786259 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1400/2795] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:53.790294 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3c51-71ca-4e60-81e8-d05236f739fd None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:53.801341 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3c51-71ca-4e60-81e8-d05236f739fd None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:53.805878 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:53.807067 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:53.807357 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:53.808783 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] PATH_INFO: `/v3/domains` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:53.809907 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66996) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:56:53.810221 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:53.811886 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:53.831787 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1396/2796] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:56:53.837600 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1328b7-7766-4016-b23d-cecdac16d6bb None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:53.848108 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1328b7-7766-4016-b23d-cecdac16d6bb None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:53.852688 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:53.853488 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:53.853837 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:53.854125 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:53.854792 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:53.856765 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:53.886698 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1401/2797] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:56:53 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:53.893623 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:53.905035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0117-0bf2-4896-b328-180ec714d51f admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:53.992881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:53.993495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:53.994367 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:53.995096 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:53.995752 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:53.997703 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:54.020073 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1397/2798] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:56:53 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:56:54.024646 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:54.036519 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d396e6-8287-45b4-b622-2ea26cb82e1e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:54.041291 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:54.041893 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:54.042188 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:54.042475 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:54.043182 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:54.044810 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:54.059576 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1402/2799] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:54.063958 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:54.074545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabe8c6-0c38-4cbf-a299-db5f42e450ed admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:54.079069 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a2a92-d9ad-40c4-a669-b3bbcd7c7298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:54.079670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a2a92-d9ad-40c4-a669-b3bbcd7c7298 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:54.079989 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a2a92-d9ad-40c4-a669-b3bbcd7c7298 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:54.080347 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a2a92-d9ad-40c4-a669-b3bbcd7c7298 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:54.080992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a2a92-d9ad-40c4-a669-b3bbcd7c7298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:54.082599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a2a92-d9ad-40c4-a669-b3bbcd7c7298 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:54.093280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1398/2800] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:56:54.099008 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:54.108786 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee807c7a-07eb-479e-928e-38b5e5045fd2 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:54.113369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:54.114193 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] REQUEST_METHOD: `PUT` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:54.114485 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:54.114771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] PATH_INFO: `/v3/projects/c0b956e0c3a74df8890d564dadb5ad70/users/8df441c38c604f1487efba726a41d411/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:54.135716 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b956e0c3a74df8890d564dadb5ad70, user_id=8df441c38c604f1487efba726a41d411, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:54.138386 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:54.153019 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1403/2801] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:56:54 2022] PUT /identity/v3/projects/c0b956e0c3a74df8890d564dadb5ad70/users/8df441c38c604f1487efba726a41d411/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:56:54.158114 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f096b-bd13-44b7-9c75-ac0274239c52 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:54.158514 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f096b-bd13-44b7-9c75-ac0274239c52 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:54.158862 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f096b-bd13-44b7-9c75-ac0274239c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:54.182006 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-975f096b-bd13-44b7-9c75-ac0274239c52 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:56:54.183477 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-975f096b-bd13-44b7-9c75-ac0274239c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:54.249398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1399/2802] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:56:54.260394 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:56:54.262737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:56:54.340440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb326c7-a682-42eb-a8f5-9cda8c4e054c admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:56:54.343963 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:56:54.344548 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:56:54.344841 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:56:54.345147 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:56:54.355014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:56:54.356409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:56:54.365949 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1404/2803] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:56:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:00.512676 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc81f-9023-4409-ae39-7c42323e1617 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.513233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc81f-9023-4409-ae39-7c42323e1617 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.513233 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcc81f-9023-4409-ae39-7c42323e1617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.552078 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-d5fcc81f-9023-4409-ae39-7c42323e1617 None None] MFA Rules not processed for user `8df441c38c604f1487efba726a41d411`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:00.553190 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-d5fcc81f-9023-4409-ae39-7c42323e1617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:00.630992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1400/2804] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:57:00 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:00.635696 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:00.649102 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1906c-71ed-4cc5-9b4b-c0bf70d15ce6 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:00.653824 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:00.654429 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.654717 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.655003 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.655650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:00.657635 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:00.688670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1405/2805] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:57:00 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 08 02:57:00.692495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcc81f-9023-4409-ae39-7c42323e1617 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:00.705518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcc81f-9023-4409-ae39-7c42323e1617 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:00.774568 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:00.775670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.775670 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.775995 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] PATH_INFO: `/v3/users` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.776403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:00.778327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:00.804407 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1401/2806] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:57:00 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:57:00.805844 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:00.820658 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3687f5-5805-4a56-9b2c-ae31504a2df7 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:00.841829 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:00.842461 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.842754 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.843043 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.843815 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:00.845484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:00.856495 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1406/2807] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:57:00.860811 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:00.871046 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f42c7f-5ca0-49c9-bff9-583e2853276e admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:00.878875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:00.879713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:00.880058 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:00.880336 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] PATH_INFO: `/v3/projects/c6332dba62154e5a9e70cb6bcf65a39e/users/8c5ba203ca064ba0aebb2fd8ef900467/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:00.901578 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6332dba62154e5a9e70cb6bcf65a39e, user_id=8c5ba203ca064ba0aebb2fd8ef900467, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:00.904295 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:00.920856 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1402/2808] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:57:00 2022] PUT /identity/v3/projects/c6332dba62154e5a9e70cb6bcf65a39e/users/8c5ba203ca064ba0aebb2fd8ef900467/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:57:00.924800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:00.936313 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0a883-7b09-48c9-861e-729bab8c42ee admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:01.020784 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768157e6-1c49-4945-b87b-03b62c54f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:01.021389 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768157e6-1c49-4945-b87b-03b62c54f407 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:01.021677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768157e6-1c49-4945-b87b-03b62c54f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:01.021961 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768157e6-1c49-4945-b87b-03b62c54f407 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:01.022660 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768157e6-1c49-4945-b87b-03b62c54f407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:01.024426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768157e6-1c49-4945-b87b-03b62c54f407 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:01.035858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1407/2809] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:57:01.039975 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:01.051124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099428ad-006f-4a98-a533-3ced3c7d716b admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:01.055677 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:01.058050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:01.058526 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:01.058880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] PATH_INFO: `/v3/projects/c6332dba62154e5a9e70cb6bcf65a39e/users/8c5ba203ca064ba0aebb2fd8ef900467/roles/3224d4d734484fac94d0c30f0093a334` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:01.060880 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6332dba62154e5a9e70cb6bcf65a39e, user_id=8c5ba203ca064ba0aebb2fd8ef900467, role_id=3224d4d734484fac94d0c30f0093a334)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:01.063580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:01.074887 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1403/2810] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:57:01 2022] PUT /identity/v3/projects/c6332dba62154e5a9e70cb6bcf65a39e/users/8c5ba203ca064ba0aebb2fd8ef900467/roles/3224d4d734484fac94d0c30f0093a334 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:07.746323 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:07.746868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:07.746868 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:07.804664 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] MFA Rules not processed for user `8c5ba203ca064ba0aebb2fd8ef900467`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:07.805905 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:07.897502 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1408/2811] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:57:07 2022] POST /identity/v3/auth/tokens => generated 3751 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:07.908224 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:07.909999 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:08.010393 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b60d92-0077-4f48-bb48-3c23a871cec9 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:08.016045 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c877-d5d3-459b-9dcb-4be0b5860cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:08.016649 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c877-d5d3-459b-9dcb-4be0b5860cd3 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:08.016948 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c877-d5d3-459b-9dcb-4be0b5860cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:08.017418 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c877-d5d3-459b-9dcb-4be0b5860cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:08.088467 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c877-d5d3-459b-9dcb-4be0b5860cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:08.090141 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c877-d5d3-459b-9dcb-4be0b5860cd3 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:08.100919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1404/2812] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:07 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:08.562281 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:08.563705 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:08.705899 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883ad6b-9e33-425f-9531-eefb3a1b62a8 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:08.711462 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:08.712865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:08.713507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:08.713950 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:08.716324 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:08.740212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:08.743402 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:08.754729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1409/2813] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:08 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:17.758090 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edd465-06a5-4e9c-a676-43fdce5e14ca None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:17.758587 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edd465-06a5-4e9c-a676-43fdce5e14ca None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:17.758690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edd465-06a5-4e9c-a676-43fdce5e14ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:17.781673 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-c1edd465-06a5-4e9c-a676-43fdce5e14ca None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:17.782890 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c1edd465-06a5-4e9c-a676-43fdce5e14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:17.847020 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1405/2814] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:57:17 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:17.887811 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:17.890436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:17.968438 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6286c9-ec63-4b22-9d81-2b88bd963ad3 service placement] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:17.976762 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc9e4f-b74d-4c44-a695-c8141d63f6b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:17.977512 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9e4f-b74d-4c44-a695-c8141d63f6b8 service swift] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:17.977985 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9e4f-b74d-4c44-a695-c8141d63f6b8 service swift] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:17.978424 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9e4f-b74d-4c44-a695-c8141d63f6b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:17.990877 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc9e4f-b74d-4c44-a695-c8141d63f6b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:17.993491 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc9e4f-b74d-4c44-a695-c8141d63f6b8 service swift] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:18.006106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1410/2815] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:35.601954 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86631f81-04bd-4389-b356-3b9bd6f926eb None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:35.602535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86631f81-04bd-4389-b356-3b9bd6f926eb None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:35.602535 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86631f81-04bd-4389-b356-3b9bd6f926eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:35.625038 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-86631f81-04bd-4389-b356-3b9bd6f926eb None None] MFA Rules not processed for user `8df441c38c604f1487efba726a41d411`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:35.626225 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-86631f81-04bd-4389-b356-3b9bd6f926eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:35.632567 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1406/2816] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:57:35 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:36.456535 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:36.457369 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:36.457819 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:36.482332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:36.483504 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:36.491158 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1411/2817] 10.222.0.23 () {58 vars in 967 bytes} [Fri Apr 8 02:57:36 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:36.503734 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86631f81-04bd-4389-b356-3b9bd6f926eb None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:36.516192 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86631f81-04bd-4389-b356-3b9bd6f926eb None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:36.521410 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:36.521987 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:36.522277 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:36.522561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:36.531545 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:36.533165 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:36.541060 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1407/2818] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:57:39.117851 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:39.119447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:39.202559 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a9d3-0059-4d4d-a955-8994e4515bf3 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:39.207712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:39.208677 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:39.208997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:39.209276 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] PATH_INFO: `/v3/users/4c73a12c1b6749b3882b510aef5cabe3` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:39.210443 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c73a12c1b6749b3882b510aef5cabe3)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:39.212405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:39.266342 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c73a12c1b6749b3882b510aef5cabe3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.274377 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c73a12c1b6749b3882b510aef5cabe3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.275071 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c73a12c1b6749b3882b510aef5cabe3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.275674 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c73a12c1b6749b3882b510aef5cabe3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.288111 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-352da793-e913-46c1-8f00-f5c3b733c2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c73a12c1b6749b3882b510aef5cabe3'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.301142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1412/2819] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:57:39 2022] DELETE /identity/v3/users/4c73a12c1b6749b3882b510aef5cabe3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:39.536668 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:39.548561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e310978-65f8-4ef0-9c30-690ff7e098c3 service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:39.618392 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:39.619342 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:39.619730 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:39.620173 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] PATH_INFO: `/v3/projects/9e2629ed0483482588959ec1e5f818af` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:39.621689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2629ed0483482588959ec1e5f818af)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:39.624473 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:39.681297 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2629ed0483482588959ec1e5f818af', 'request_id': 'req-f13d8bae-c1dc-4192-b324-3272f6cedcd4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.688477 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2629ed0483482588959ec1e5f818af', 'request_id': 'req-f13d8bae-c1dc-4192-b324-3272f6cedcd4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.698310 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2629ed0483482588959ec1e5f818af', 'request_id': 'req-f13d8bae-c1dc-4192-b324-3272f6cedcd4'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.724891 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] The token cache is being invalidate because project 9e2629ed0483482588959ec1e5f818af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:57:39.725213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.725875 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-f13d8bae-c1dc-4192-b324-3272f6cedcd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:57:39.727666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1408/2820] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:57:39 2022] DELETE /identity/v3/projects/9e2629ed0483482588959ec1e5f818af => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 02:57:39.733212 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6ebe-310d-4d9c-ab07-ad468073e725 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:39.733787 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6ebe-310d-4d9c-ab07-ad468073e725 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:39.734308 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6ebe-310d-4d9c-ab07-ad468073e725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:39.759644 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-3aeb6ebe-310d-4d9c-ab07-ad468073e725 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:39.761007 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3aeb6ebe-310d-4d9c-ab07-ad468073e725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:39.852849 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1413/2821] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:39.853099 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c976-e88a-45ef-84c9-3999ceef895c None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:39.853390 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c976-e88a-45ef-84c9-3999ceef895c None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:39.853683 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c976-e88a-45ef-84c9-3999ceef895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:39.879722 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-fd38c976-e88a-45ef-84c9-3999ceef895c None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:39.880826 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-fd38c976-e88a-45ef-84c9-3999ceef895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:39.891749 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1409/2822] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:39.896017 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb6ebe-310d-4d9c-ab07-ad468073e725 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:39.906744 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb6ebe-310d-4d9c-ab07-ad468073e725 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:39.912047 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:39.912670 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:39.912958 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:39.913237 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] PATH_INFO: `/v3/domains` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:39.914105 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66995) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 08 02:57:39.914418 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:39.916409 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:39.933344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1414/2823] 10.222.0.23 () {58 vars in 1152 bytes} [Fri Apr 8 02:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 08 02:57:39.934602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38c976-e88a-45ef-84c9-3999ceef895c None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:39.943830 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38c976-e88a-45ef-84c9-3999ceef895c None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:39.948383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:39.949024 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:39.949378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:39.950816 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] PATH_INFO: `/v3/projects` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:39.951150 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:39.953335 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:39.987475 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1410/2824] 10.222.0.23 () {60 vars in 1152 bytes} [Fri Apr 8 02:57:39 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:57:39.991484 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:40.003408 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067bf03-b1e7-4d3f-892a-3f80f612024f admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:40.114710 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:40.115892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:40.115892 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:40.116142 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] PATH_INFO: `/v3/users` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:40.116620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:40.118853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:40.150679 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1415/2825] 10.222.0.23 () {60 vars in 1143 bytes} [Fri Apr 8 02:57:39 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 08 02:57:40.155226 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:40.176661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e876c-7563-4710-a5a9-7c1f1e617946 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:40.181921 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:40.183340 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:40.183902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:40.184585 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] PATH_INFO: `/v3/roles` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:40.186301 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:40.188281 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:40.200866 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1411/2826] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 08 02:57:40.204759 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:40.219151 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868954b-bd74-43b0-b9dc-4be6b1031e92 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:40.224453 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382d895-8533-437e-95e2-5d690a9ab0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:40.225065 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382d895-8533-437e-95e2-5d690a9ab0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:40.225541 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382d895-8533-437e-95e2-5d690a9ab0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:40.225984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382d895-8533-437e-95e2-5d690a9ab0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:40.227210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382d895-8533-437e-95e2-5d690a9ab0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:40.229243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382d895-8533-437e-95e2-5d690a9ab0b4 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:40.250590 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1416/2827] 10.222.0.23 () {58 vars in 1121 bytes} [Fri Apr 8 02:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 08 02:57:40.251860 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:40.261527 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f164080-a40b-4a60-9202-7672dead4148 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:40.266228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:40.267302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] REQUEST_METHOD: `PUT` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:40.267664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:40.268094 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] PATH_INFO: `/v3/projects/3bcbf5128513465d90455031cb597111/users/642f135899cc46d982a09e345d254a3c/roles/042411de09cb47e0a875e39fd1ace847` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:40.302724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bcbf5128513465d90455031cb597111, user_id=642f135899cc46d982a09e345d254a3c, role_id=042411de09cb47e0a875e39fd1ace847)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:40.305441 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:40.320542 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1412/2828] 10.222.0.23 () {60 vars in 1482 bytes} [Fri Apr 8 02:57:40 2022] PUT /identity/v3/projects/3bcbf5128513465d90455031cb597111/users/642f135899cc46d982a09e345d254a3c/roles/042411de09cb47e0a875e39fd1ace847 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:57:40.331426 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588533d3-9fb1-4b93-b749-4c1ff76ef00a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:40.332253 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588533d3-9fb1-4b93-b749-4c1ff76ef00a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:40.332781 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588533d3-9fb1-4b93-b749-4c1ff76ef00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:40.371720 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-588533d3-9fb1-4b93-b749-4c1ff76ef00a None None] MFA Rules not processed for user `642f135899cc46d982a09e345d254a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:40.373050 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-588533d3-9fb1-4b93-b749-4c1ff76ef00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:40.487858 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1417/2829] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:57:40 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:57:40.499324 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:40.501193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:40.628134 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdfae4-4875-4d39-94fa-05d0afecfc32 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:40.631964 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:40.632633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:40.633028 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:40.633391 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:40.642985 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:40.644694 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:40.655280 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1413/2830] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:40 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:42.152446 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfb8f2-760c-42bc-a8d3-c403fd7efe15 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:42.153004 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfb8f2-760c-42bc-a8d3-c403fd7efe15 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:42.153278 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfb8f2-760c-42bc-a8d3-c403fd7efe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:42.175304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-82bfb8f2-760c-42bc-a8d3-c403fd7efe15 None None] MFA Rules not processed for user `642f135899cc46d982a09e345d254a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:42.176486 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-82bfb8f2-760c-42bc-a8d3-c403fd7efe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:42.182984 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1418/2831] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:57:42 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:53.910009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:53.911991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:53.987607 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595522-4ded-41d1-9bb5-66ab8f7fedde service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:57:53.993446 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:57:53.994037 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:53.994327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:53.994616 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:53.997138 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:54.084913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:57:54.086409 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:57:54.096615 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1414/2832] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:57:53 2022] GET /identity/v3/auth/tokens => generated 3751 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:57:59.841476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac50f39-509e-4fae-b360-207c165f0b30 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:57:59.841974 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac50f39-509e-4fae-b360-207c165f0b30 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:57:59.842089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac50f39-509e-4fae-b360-207c165f0b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:57:59.864144 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-fac50f39-509e-4fae-b360-207c165f0b30 None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:57:59.865327 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-fac50f39-509e-4fae-b360-207c165f0b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:57:59.926987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1419/2833] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:57:59.939871 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:57:59.941219 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:00.013923 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f73c-03ec-4772-a023-9538b65568a9 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:00.018701 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:00.019271 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:00.019561 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:00.019847 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:00.027620 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:00.030193 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:00.037732 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1415/2834] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:57:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:58:00.657434 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789bba-789e-45e3-9977-3ab579994b5d None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:00.657735 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789bba-789e-45e3-9977-3ab579994b5d None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:00.658026 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789bba-789e-45e3-9977-3ab579994b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:00.679410 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-34789bba-789e-45e3-9977-3ab579994b5d None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:58:00.680593 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-34789bba-789e-45e3-9977-3ab579994b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:00.687423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1420/2835] 10.222.0.23 () {58 vars in 967 bytes} [Fri Apr 8 02:58:00 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:58:00.699228 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:00.711039 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d84ce-733e-43be-8bb2-d1ecf4a27a82 service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:00.717124 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:00.717711 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:00.718015 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:00.718302 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:00.726602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:00.728206 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:00.735939 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1416/2836] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:58:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:58:00.956243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63257f8-bd5b-40d4-8b6f-c225709bde8f None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:00.956766 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63257f8-bd5b-40d4-8b6f-c225709bde8f None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:00.956865 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63257f8-bd5b-40d4-8b6f-c225709bde8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:00.978477 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-f63257f8-bd5b-40d4-8b6f-c225709bde8f None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:58:00.979634 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f63257f8-bd5b-40d4-8b6f-c225709bde8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:00.986355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1421/2837] 10.222.0.23 () {58 vars in 1009 bytes} [Fri Apr 8 02:58:00 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:58:00.998661 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:01.009092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84c434-2d5d-4670-bb14-1e868cfeeda6 service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:01.014629 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:01.015213 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:01.015508 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:01.015793 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:01.025494 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:01.027064 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:01.034910 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1417/2838] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:58:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 08 02:58:01.425817 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e59e-47f8-42ab-a76b-1f9ae8593d86 None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:01.426114 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e59e-47f8-42ab-a76b-1f9ae8593d86 None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:01.426403 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3e59e-47f8-42ab-a76b-1f9ae8593d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:01.449310 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-92f3e59e-47f8-42ab-a76b-1f9ae8593d86 None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:58:01.450498 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-92f3e59e-47f8-42ab-a76b-1f9ae8593d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:01.457129 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1422/2839] 10.222.0.23 () {58 vars in 967 bytes} [Fri Apr 8 02:58:01 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:58:01.469427 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:01.479495 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e06ad-efca-4018-9cab-411ba61f093d service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:01.485404 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f8495-4be2-4911-9389-e2f1cb3f6877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:01.485979 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f8495-4be2-4911-9389-e2f1cb3f6877 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:01.486268 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f8495-4be2-4911-9389-e2f1cb3f6877 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:01.486552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f8495-4be2-4911-9389-e2f1cb3f6877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:01.494664 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f8495-4be2-4911-9389-e2f1cb3f6877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:01.496250 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f8495-4be2-4911-9389-e2f1cb3f6877 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:01.504913 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1418/2840] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:58:04.121015 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e59e-47f8-42ab-a76b-1f9ae8593d86 None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:04.189835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3e59e-47f8-42ab-a76b-1f9ae8593d86 None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:04.194057 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:04.194853 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:04.195146 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:04.195436 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] PATH_INFO: `/v3/users/642f135899cc46d982a09e345d254a3c` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:04.196580 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642f135899cc46d982a09e345d254a3c)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:04.198591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:04.248300 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642f135899cc46d982a09e345d254a3c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.256337 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642f135899cc46d982a09e345d254a3c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.256991 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642f135899cc46d982a09e345d254a3c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.257589 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642f135899cc46d982a09e345d254a3c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.269771 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642f135899cc46d982a09e345d254a3c'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.282412 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1423/2841] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:58:04 2022] DELETE /identity/v3/users/642f135899cc46d982a09e345d254a3c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:58:04.286967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:04.287463 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:04.287580 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:04.309130 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] MFA Rules not processed for user `c7f64b1e79994a23a6fbc99fe8cef153`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:58:04.310328 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:04.373378 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1419/2842] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 02:58:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 08 02:58:04.383441 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:04.384821 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:04.449691 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40aa55-0550-4a73-b82d-9df9cb6b4a58 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:04.454203 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:04.454774 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:04.455060 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:04.455345 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:04.464068 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:04.465487 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:04.476020 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1424/2843] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:58:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:58:04.694167 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:04.695618 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:04.707969 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3699a-dded-4a86-bc74-f4238456e021 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:04.712205 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:04.712991 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:04.713265 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:04.713543 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] PATH_INFO: `/v3/projects/3bcbf5128513465d90455031cb597111` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:04.714621 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bcbf5128513465d90455031cb597111)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:04.716533 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:04.766469 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bcbf5128513465d90455031cb597111', 'request_id': 'req-5869e820-9b2f-46f2-b09e-b681cceb1ad7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.771356 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bcbf5128513465d90455031cb597111', 'request_id': 'req-5869e820-9b2f-46f2-b09e-b681cceb1ad7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.777976 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bcbf5128513465d90455031cb597111', 'request_id': 'req-5869e820-9b2f-46f2-b09e-b681cceb1ad7'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.793642 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] The token cache is being invalidate because project 3bcbf5128513465d90455031cb597111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:58:04.793926 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.794541 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:58:04.796489 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1420/2844] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:58:04 2022] DELETE /identity/v3/projects/3bcbf5128513465d90455031cb597111 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:58:49.187709 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:49.189154 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:49.199987 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e5c9b-a2d7-4984-93ba-d14eb7e4b11c service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:49.265650 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ad440-05de-4268-9f69-34ed0e4f1d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:49.266234 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ad440-05de-4268-9f69-34ed0e4f1d94 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:49.266531 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ad440-05de-4268-9f69-34ed0e4f1d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:49.266828 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ad440-05de-4268-9f69-34ed0e4f1d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:49.268552 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-568ad440-05de-4268-9f69-34ed0e4f1d94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:49.368163 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ad440-05de-4268-9f69-34ed0e4f1d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:49.369510 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ad440-05de-4268-9f69-34ed0e4f1d94 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:49.390713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1425/2845] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:58:49 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:58:53.532383 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:53.534222 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:53.612275 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869e820-9b2f-46f2-b09e-b681cceb1ad7 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:53.616487 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:53.617082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:53.617742 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:53.618035 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:53.619753 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:53.636704 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:53.638366 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:53.649529 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1421/2846] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:58:53 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 02:58:59.058620 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] REQUEST_METHOD: `POST` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:59.059106 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:59.059210 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:59.135089 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.auth.core [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] MFA Rules not processed for user `51a85bd55f4749aa9aa37a834229f06b`. Rule list: `[]` (Enabled: `True`). {{(pid=66995) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 02:58:59.136268 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:59.207140 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1426/2847] 10.222.0.23 () {58 vars in 967 bytes} [Fri Apr 8 02:58:59 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 02:58:59.228789 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:58:59.230218 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:58:59.329974 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822d84-6507-4ab2-b8df-dd86321dfc8e service cinder] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:58:59.334769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7dcb623e589c4b17a7a9b3b022c51f96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:58:59.335351 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:58:59.335646 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:58:59.336009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:58:59.344518 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:58:59.346133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:58:59.353761 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1422/2848] 10.222.0.23 () {60 vars in 1384 bytes} [Fri Apr 8 02:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 08 02:59:09.629507 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:09.630875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:09.703194 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8061-4b88-4c6c-badd-df3571b3c69a None None] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:09.707880 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:09.708736 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:09.709049 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:09.709330 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] PATH_INFO: `/v3/users/38c39d689d5b4a848bbab29270c58318` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:09.710476 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c39d689d5b4a848bbab29270c58318)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:09.712447 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:59:09.761581 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c39d689d5b4a848bbab29270c58318'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:09.769440 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c39d689d5b4a848bbab29270c58318'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:09.770088 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c39d689d5b4a848bbab29270c58318'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:09.770729 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c39d689d5b4a848bbab29270c58318'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:09.782848 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c39d689d5b4a848bbab29270c58318'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:09.795546 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1427/2849] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:59:09 2022] DELETE /identity/v3/users/38c39d689d5b4a848bbab29270c58318 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:59:10.022443 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:10.033132 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15713-0829-47e4-9a3b-cd707cc4daf0 service swift] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:10.101627 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:10.102419 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:10.102709 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:10.102993 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] PATH_INFO: `/v3/projects/db379f877ebf4bda8bcef28d03d0e3bb` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:10.104122 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db379f877ebf4bda8bcef28d03d0e3bb)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:10.106031 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:59:10.153760 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db379f877ebf4bda8bcef28d03d0e3bb', 'request_id': 'req-99e67c9f-9206-40b6-8b8a-80a162384a9a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.158695 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db379f877ebf4bda8bcef28d03d0e3bb', 'request_id': 'req-99e67c9f-9206-40b6-8b8a-80a162384a9a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.165105 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db379f877ebf4bda8bcef28d03d0e3bb', 'request_id': 'req-99e67c9f-9206-40b6-8b8a-80a162384a9a'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.180889 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] The token cache is being invalidate because project db379f877ebf4bda8bcef28d03d0e3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:59:10.181172 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.181792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.183450 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1423/2850] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:59:10 2022] DELETE /identity/v3/projects/db379f877ebf4bda8bcef28d03d0e3bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:59:10.188001 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:10.189329 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:10.202012 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a693990-ab8a-4efd-8d36-7836f4af2789 admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:10.263872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:10.264615 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:10.264900 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:10.265179 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] PATH_INFO: `/v3/users/75cf63d85a824829af05d886e27c2c43` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:10.266270 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cf63d85a824829af05d886e27c2c43)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:10.268243 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:59:10.319712 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cf63d85a824829af05d886e27c2c43'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.327609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cf63d85a824829af05d886e27c2c43'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.328255 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cf63d85a824829af05d886e27c2c43'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.328872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cf63d85a824829af05d886e27c2c43'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.340216 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cf63d85a824829af05d886e27c2c43'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.352800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1428/2851] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 02:59:10 2022] DELETE /identity/v3/users/75cf63d85a824829af05d886e27c2c43 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:59:10.661434 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:10.662873 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:10.676440 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e67c9f-9206-40b6-8b8a-80a162384a9a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:10.738032 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:10.738927 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:10.739309 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:10.739689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] PATH_INFO: `/v3/projects/c0c97ec02b814790879ce9c892a62ec5` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:10.740947 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c97ec02b814790879ce9c892a62ec5)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:10.743497 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:59:10.791058 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c97ec02b814790879ce9c892a62ec5', 'request_id': 'req-28dbf746-0d68-4ba7-9c23-02480319faf2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.796671 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c97ec02b814790879ce9c892a62ec5', 'request_id': 'req-28dbf746-0d68-4ba7-9c23-02480319faf2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.803373 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c97ec02b814790879ce9c892a62ec5', 'request_id': 'req-28dbf746-0d68-4ba7-9c23-02480319faf2'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.820135 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] The token cache is being invalidate because project c0c97ec02b814790879ce9c892a62ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66996) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 02:59:10.820426 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.821050 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-28dbf746-0d68-4ba7-9c23-02480319faf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 02:59:10.822506 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1424/2852] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 02:59:10 2022] DELETE /identity/v3/projects/c0c97ec02b814790879ce9c892a62ec5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 02:59:41.788396 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 02:59:41.789668 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:41.853451 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e0d63-9437-46a0-88a9-0a0046ebc7cd admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 02:59:41.910945 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 02:59:41.911523 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 02:59:41.911809 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 02:59:41.912127 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 02:59:41.913806 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 02:59:41.923482 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 02:59:41.924927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 02:59:41.932591 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1429/2853] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 02:59:41 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:00:16.385717 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:00:16.386264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:00:16.386382 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:00:16.408823 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] MFA Rules not processed for user `8df441c38c604f1487efba726a41d411`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 03:00:16.409982 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:00:16.470605 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1425/2854] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 03:00:16 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 03:00:19.612891 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:00:19.614309 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:00:19.688405 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650778c8-1d19-4416-b5be-f76f28070d98 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:00:19.693056 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:00:19.693636 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:00:19.693929 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:00:19.694215 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:00:19.695969 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:00:19.707067 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:00:19.708680 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:00:19.720480 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1430/2855] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:00:19 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:00:20.828967 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:00:20.830327 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:00:20.845092 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cd52b-358f-4ced-b1c8-f3f1dfe78fd9 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:00:20.849689 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338935-3bde-4e0f-8a16-fd63d5dd3e5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:00:20.850264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338935-3bde-4e0f-8a16-fd63d5dd3e5c service placement] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:00:20.850552 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338935-3bde-4e0f-8a16-fd63d5dd3e5c service placement] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:00:20.850946 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338935-3bde-4e0f-8a16-fd63d5dd3e5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:00:20.852614 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-a4338935-3bde-4e0f-8a16-fd63d5dd3e5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:00:20.867883 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4338935-3bde-4e0f-8a16-fd63d5dd3e5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:00:20.869490 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4338935-3bde-4e0f-8a16-fd63d5dd3e5c service placement] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:00:20.879833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1426/2856] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:00:20 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:22.788908 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:22.790181 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:22.853723 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45aca68-1af1-4869-be8e-b0809b92aec2 service placement] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:22.857297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e240ede71df43708e2fb859c99b0a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:22.857875 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:22.858169 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:22.858458 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:22.860168 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:22.870527 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:22.871969 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:02:22.880927 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1431/2857] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:22 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:34.408148 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af7ced-c081-4b08-8742-9abf1d6d52b8 None None] REQUEST_METHOD: `POST` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:34.408685 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af7ced-c081-4b08-8742-9abf1d6d52b8 None None] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:34.408794 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af7ced-c081-4b08-8742-9abf1d6d52b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:34.429959 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.auth.core [None req-e4af7ced-c081-4b08-8742-9abf1d6d52b8 None None] MFA Rules not processed for user `8df441c38c604f1487efba726a41d411`. Rule list: `[]` (Enabled: `True`). {{(pid=66996) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 08 03:02:34.431102 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-e4af7ced-c081-4b08-8742-9abf1d6d52b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:34.438303 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1427/2858] 10.222.0.23 () {58 vars in 957 bytes} [Fri Apr 8 03:02:34 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 08 03:02:34.942610 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:34.944098 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:34.956054 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c88c15-4bde-4031-8ade-bc7c038e74f3 service cinder] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:34.959431 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:34.960055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:34.960347 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:34.960631 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:34.962223 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:34.971555 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:34.972994 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:02:34.981239 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1432/2859] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:34 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:36.087624 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af7ced-c081-4b08-8742-9abf1d6d52b8 None None] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:36.099763 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af7ced-c081-4b08-8742-9abf1d6d52b8 None None] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:36.105189 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:36.105792 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:36.106084 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:36.106402 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:36.108118 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:36.118973 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:36.120690 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:02:36.129990 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1428/2860] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:36 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:38.768726 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:38.770959 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:38.862609 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c3f1b-a209-4793-aead-8de3ee02c7e1 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:38.868295 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:38.868897 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:38.869191 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:38.870059 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:38.871816 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:38.884025 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:38.885733 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:02:38.897045 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1433/2861] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:38 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:02:50.270617 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:02:50.282559 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaf00e-1b73-4839-a85b-be6626e8590e service placement] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:02:50.287725 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:02:50.288398 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:02:50.288693 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:02:50.289082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:02:50.290771 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:02:50.302334 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:02:50.303901 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:02:50.314941 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1429/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:02:50 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:04:44.740587 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:44.750455 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45056f4-fdd4-4b49-9fcb-074ba31cd9db service nova] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:44.753909 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:44.754423 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:44.754713 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:44.754997 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:44.762835 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:44.764283 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:04:44.772162 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1434/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:04:44 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:04:46.440536 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:46.443531 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:46.460599 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38312a98-ce68-4b71-8c9d-d48c10194dc8 service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:46.467098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f724e05a70194ed992e73c9ca77eaef3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:46.470602 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:46.471197 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:46.471657 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:46.473881 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:46.490666 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:46.493214 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:04:46.508326 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1430/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:04:46.730558 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:46.732064 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:46.743044 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1599b-a14b-4bb3-a7dc-09a95e2c4e42 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:46.747344 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:46.748211 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:46.748704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:46.749183 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:46.751055 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:46.764672 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:46.766355 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:04:46.777235 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1435/2865] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:04:48.157312 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:04:48.166719 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1f474-968e-4601-a6d2-ef47791fee5a service nova] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:04:48.170569 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:04:48.171143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:04:48.171437 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:04:48.171724 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:04:48.173403 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:04:48.186633 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:04:48.188082 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:04:48.199137 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1431/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:05:02.084332 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:05:02.093607 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3abce-2409-4c66-bef7-281ee834df86 service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:05:02.097141 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '865abd5c9d3b454ca1011e6e3111f580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:05:02.097704 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] REQUEST_METHOD: `GET` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:05:02.098014 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:05:02.098297 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:05:02.099978 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:05:02.171040 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:05:02.172540 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:05:02.181602 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1436/2867] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:05:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 08 03:05:12.318445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:05:12.319903 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:05:12.333018 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7761d3-fa48-4f62-96b7-d85b7a11c667 service neutron] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:05:12.337637 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:05:12.338521 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:05:12.338808 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:05:12.339098 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] PATH_INFO: `/v3/users/8df441c38c604f1487efba726a41d411` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:05:12.340238 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df441c38c604f1487efba726a41d411)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:05:12.342143 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:05:12.389799 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df441c38c604f1487efba726a41d411'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.390451 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df441c38c604f1487efba726a41d411'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.402279 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df441c38c604f1487efba726a41d411'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.402919 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df441c38c604f1487efba726a41d411'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.410272 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df441c38c604f1487efba726a41d411'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.422074 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1432/2868] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 03:05:12 2022] DELETE /identity/v3/users/8df441c38c604f1487efba726a41d411 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 03:05:12.648800 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:05:12.658872 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7745fbc-7164-414d-875b-8c86771970fb service neutron] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:05:12.721381 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:05:12.722198 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:05:12.722490 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:05:12.722777 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] PATH_INFO: `/v3/projects/c0b956e0c3a74df8890d564dadb5ad70` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:05:12.723881 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b956e0c3a74df8890d564dadb5ad70)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:05:12.725807 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:05:12.774322 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b956e0c3a74df8890d564dadb5ad70', 'request_id': 'req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.781833 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b956e0c3a74df8890d564dadb5ad70', 'request_id': 'req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.793683 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b956e0c3a74df8890d564dadb5ad70', 'request_id': 'req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.803390 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] The token cache is being invalidate because project c0b956e0c3a74df8890d564dadb5ad70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 03:05:12.803673 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.804304 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.805724 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1437/2869] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 03:05:12 2022] DELETE /identity/v3/projects/c0b956e0c3a74df8890d564dadb5ad70 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 03:05:12.811081 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:05:12.812445 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:05:12.824972 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffb53d-adcc-401b-be8a-537466bfb70a admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:05:12.887479 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:05:12.888254 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:05:12.888549 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:05:12.888834 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] PATH_INFO: `/v3/users/8c5ba203ca064ba0aebb2fd8ef900467` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:05:12.889930 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5ba203ca064ba0aebb2fd8ef900467)` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:05:12.891833 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:05:12.938264 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5ba203ca064ba0aebb2fd8ef900467'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.938902 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5ba203ca064ba0aebb2fd8ef900467'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.950950 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5ba203ca064ba0aebb2fd8ef900467'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.951638 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5ba203ca064ba0aebb2fd8ef900467'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.959133 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.notifications [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5ba203ca064ba0aebb2fd8ef900467'} {{(pid=66996) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:12.971639 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1433/2870] 10.222.0.23 () {58 vars in 1223 bytes} [Fri Apr 8 03:05:12 2022] DELETE /identity/v3/users/8c5ba203ca064ba0aebb2fd8ef900467 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 08 03:05:13.189085 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Authenticating user token {{(pid=66995) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:05:13.190556 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.fernet_utils [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66995) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:05:13.203262 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa27c46-0ff3-40f3-bf4b-89ae0bdc455e admin admin] Validating token access rules against request {{(pid=66995) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:05:13.273943 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f64b1e79994a23a6fbc99fe8cef153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ddce90037c4fbb82757aded33c6c12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66995) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:05:13.274737 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:05:13.275029 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] SCRIPT_NAME: `/identity` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:05:13.275316 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] PATH_INFO: `/v3/projects/c6332dba62154e5a9e70cb6bcf65a39e` {{(pid=66995) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:05:13.277005 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6332dba62154e5a9e70cb6bcf65a39e)` {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:05:13.278904 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] RBAC: Authorization granted {{(pid=66995) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:05:13.326379 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6332dba62154e5a9e70cb6bcf65a39e', 'request_id': 'req-eb38b45a-a0f1-4bed-a6d7-436493369250'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:13.332303 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6332dba62154e5a9e70cb6bcf65a39e', 'request_id': 'req-eb38b45a-a0f1-4bed-a6d7-436493369250'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:13.343965 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6332dba62154e5a9e70cb6bcf65a39e', 'request_id': 'req-eb38b45a-a0f1-4bed-a6d7-436493369250'} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:13.353648 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] The token cache is being invalidate because project c6332dba62154e5a9e70cb6bcf65a39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66995) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 08 03:05:13.353977 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:13.355075 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: DEBUG keystone.notifications [None req-eb38b45a-a0f1-4bed-a6d7-436493369250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66995) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 08 03:05:13.356628 dv-cinder-837051-1-iscsi devstack@keystone.service[66995]: [pid: 66995|app: 0|req: 1438/2871] 10.222.0.23 () {58 vars in 1232 bytes} [Fri Apr 8 03:05:13 2022] DELETE /identity/v3/projects/c6332dba62154e5a9e70cb6bcf65a39e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 08 03:07:50.985769 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Authenticating user token {{(pid=66996) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 08 03:07:50.987116 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:07:51.137385 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda88414-7a7b-41dc-8706-c92796f0cbf6 admin admin] Validating token access rules against request {{(pid=66996) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 08 03:07:51.205115 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6176db0-8d3e-48d7-bcb1-4732603e4b41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ed63325027545d1bb46f1031a736089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1a6fa2ee4d845909aeded129c76b0be', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66996) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 08 03:07:51.205713 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6176db0-8d3e-48d7-bcb1-4732603e4b41 service placement] REQUEST_METHOD: `GET` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 08 03:07:51.206009 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6176db0-8d3e-48d7-bcb1-4732603e4b41 service placement] SCRIPT_NAME: `/identity` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 08 03:07:51.206298 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6176db0-8d3e-48d7-bcb1-4732603e4b41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66996) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 08 03:07:51.207992 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.fernet_utils [None req-b6176db0-8d3e-48d7-bcb1-4732603e4b41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66996) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 08 03:07:51.219273 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6176db0-8d3e-48d7-bcb1-4732603e4b41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 08 03:07:51.220872 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6176db0-8d3e-48d7-bcb1-4732603e4b41 service placement] RBAC: Authorization granted {{(pid=66996) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 08 03:07:51.230852 dv-cinder-837051-1-iscsi devstack@keystone.service[66996]: [pid: 66996|app: 0|req: 1434/2872] 10.222.0.23 () {60 vars in 1365 bytes} [Fri Apr 8 03:07:50 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)